-- Logs begin at Fri 2022-07-15 21:06:14 UTC, end at Fri 2022-07-15 22:10:16 UTC. -- Jul 15 21:43:11.266154 dv-osbrick-836063-9-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 21:43:11.275397 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 21:43:11 2022] *** Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: nodename: dv-osbrick-836063-9-ceph Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: machine: x86_64 Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: clock source: unix Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: pcre jit disabled Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: detected number of CPU cores: 4 Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: current working directory: / Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: detected binary path: /usr/bin/uwsgi-core Jul 15 21:43:11.277415 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: your processes number limit is 47680 Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: your memory page size is 4096 bytes Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: detected max file descriptor number: 2048 Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: lock engine: pthread robust mutexes Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: thunder lock: enabled Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 21:43:11.278125 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 21:43:11.321714 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: Python main interpreter initialized at 0x55c57369e9c0 Jul 15 21:43:11.321714 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: python threads support enabled Jul 15 21:43:11.321714 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: your server socket listen backlog is limited to 100 connections Jul 15 21:43:11.321714 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: your mercy for graceful operations on workers is 90 seconds Jul 15 21:43:11.322157 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 21:43:11.322157 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: *** Operational MODE: preforking *** Jul 15 21:43:11.322452 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: *** uWSGI is running in multiple interpreter mode *** Jul 15 21:43:11.322452 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: spawned uWSGI master process (pid: 87522) Jul 15 21:43:11.322661 dv-osbrick-836063-9-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 15 21:43:11.323880 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: spawned uWSGI worker 1 (pid: 87534, cores: 1) Jul 15 21:43:11.323880 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: spawned uWSGI worker 2 (pid: 87535, cores: 1) Jul 15 21:43:11.323880 dv-osbrick-836063-9-ceph devstack@keystone.service[87522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 21:43:16.923949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 21:43:16.923949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: from cryptography.utils import int_from_bytes Jul 15 21:43:16.924800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 21:43:16.924800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: from cryptography.utils import int_from_bytes Jul 15 21:43:16.925221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 21:43:16.925221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: from cryptography.utils import int_from_bytes Jul 15 21:43:16.925324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 21:43:16.925324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: from cryptography.utils import int_from_bytes Jul 15 21:43:16.971834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 21:43:16.972025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 21:43:16.972153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 21:43:16.972256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] command line args: [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 21:43:16.972324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 21:43:16.972440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 21:43:16.972523 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] command line args: [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 21:43:16.972584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ================================================================================ {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 21:43:16.972797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 21:43:16.972920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] admin_token = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973005 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ================================================================================ {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 21:43:16.973068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] config_dir = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] admin_token = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973279 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] config_source = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] config_dir = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] debug = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973602 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.973759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] config_source = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] debug = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975903 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.975967 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_config_append = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_dir = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976482 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_config_append = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_file = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_dir = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976784 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_file = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976913 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.976971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977028 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977084 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977503 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977583 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977707 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.977827 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978021 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978225 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978493 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978798 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.978957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979598 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] publish_errors = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.979943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] publish_errors = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980486 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980712 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.980942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] standard_threads = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981067 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981229 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981507 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] standard_threads = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981585 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981752 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] use_journal = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.981934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] use_json = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] use_stderr = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] use_journal = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] use_syslog = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] use_json = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982399 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] use_stderr = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.982799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] use_syslog = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 21:43:16.982961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983102 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983429 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983868 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.983974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984329 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984441 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984669 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984780 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.984905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985133 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985721 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.985996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.986999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987111 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.987897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.988950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989640 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.989892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990692 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.990940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991052 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991399 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991510 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991627 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.991961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992264 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992374 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992484 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.992934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993151 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993371 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.993978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994422 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994538 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.994874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995189 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995307 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995453 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995575 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.995924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996273 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996716 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.996946 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997647 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997772 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.997900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998603 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.998954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:16.999992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000215 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000568 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.000893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001236 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001348 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.001927 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002041 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002158 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002498 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002742 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.002963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003386 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003734 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.003955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004768 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.004887 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005000 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005111 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005223 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005453 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.005997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006111 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006222 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.006902 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.external = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007586 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.007932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.external = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.password = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] auth.token = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008668 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.008894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.password = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] auth.token = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009228 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009801 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.009927 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010175 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010403 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010515 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010626 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.010973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011772 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.011890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012243 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012698 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012819 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.012933 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013386 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013499 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013722 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013833 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.013961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014535 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014535 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.014966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015184 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.015978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016435 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016545 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.016961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.017911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018138 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018389 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018725 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.018963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019413 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.019989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020106 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020458 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020808 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.020919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021264 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.021882 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022028 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022170 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.022912 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.023959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024243 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.024834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025594 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.025909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.026982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027079 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027174 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.027959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028053 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028156 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.028841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029053 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029398 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.029963 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030449 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030650 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.030918 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031042 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031720 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031833 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.031945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032621 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032734 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032846 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.032956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033526 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033639 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.033932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034162 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034512 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034627 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034739 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034851 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.034962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035641 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.035973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036427 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036762 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036873 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.036984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.037888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038215 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038559 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.038900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039021 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039284 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.039969 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] role.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] role.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040763 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.040984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] role.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041330 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] role.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041554 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.041919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042372 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.042928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043269 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.043983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044208 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.044990 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.045762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046515 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046635 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046862 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.046973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047084 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047526 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.047966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048081 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048303 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048524 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048644 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048869 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.048980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049092 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049658 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.049896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050021 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.050906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051017 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.051905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052248 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.connection = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.052909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053190 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.connection = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053423 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053423 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053636 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.053904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054022 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054713 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054713 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.054922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055036 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.055955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056067 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056403 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 21:43:17.056753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 21:43:17.085761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.086003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.086226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.086317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.086474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.086665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.095009 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.095210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.122773 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.122950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.123088 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.123251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.173892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.174347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.224206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.224432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.224823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.225085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.288859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289533 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289854 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.289986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.290084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.290163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.290227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.312664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.312802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.312941 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313342 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313495 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313618 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313748 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.313940 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.314002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.314076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.326966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.327249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.339816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340479 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340794 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.340996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.341062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.341129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.341307 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 21:43:17.358388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.358573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 21:43:17.358737 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.358882 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.358964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 21:43:17.359098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 21:43:17.359259 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.359369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.359504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 21:43:17.359585 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.359733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.359854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.359965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.360070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.360203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.360476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371724 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.371959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.372241 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.379817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.380276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.383149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.383418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.383689 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.383834 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.383975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384827 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.384989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.385099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.385215 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.387880 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.387984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388183 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.388399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.412091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.413347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.413810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.414104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.415104 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.415365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.419282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.419554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.419826 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.420569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.420843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.421118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.427044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.427261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.428372 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.428651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.431750 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.432139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.432415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.432692 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.432960 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.433084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.433223 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.433464 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.433592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.433743 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.433827 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.434032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.434303 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.434558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.434818 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.435068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.452058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.452326 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.453568 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.453833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.456920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.458477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.460647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.460931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.462195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.462485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.465941 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.467450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.469424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.471043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.473143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.473435 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.473712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.474014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.474276 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.474580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.474845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.475135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.475448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.475696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.475957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.476251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.493664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.493972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.494233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.494480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.495050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.495349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.495569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.495855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.502430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.503732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.504123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.504392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.505439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.505711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.507587 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.507857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.508134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.508413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.508702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.508828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.509039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.509313 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.509597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.509893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.521879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.522160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.522429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.522704 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.522972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.523238 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.523479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.523607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.523759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.523992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.524290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.524566 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.524819 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.525089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.541549 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.544772 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.545135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.548043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.548370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.549611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.551272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.551464 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.551665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.551792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.553424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.555089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.555362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.555608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.559130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.560722 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.563008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.563897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.564178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.564449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.564594 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.564735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.567801 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.568089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.568458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.568779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.573657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.573972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.575254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.577805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.578107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.579414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.583129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.583387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.583665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.583928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.584256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.584527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.584775 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.585057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.585315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.585547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.585846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.586127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.586381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.586630 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.587557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 21:43:17.587831 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.588122 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.588423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.588698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.588975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.589289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.589528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.589790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.590065 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.590347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.590613 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.590891 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.591157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 21:43:17.624610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c57369e9c0 pid: 87535 (default app) Jul 15 21:43:17.627908 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51976f-f8c7-444a-b8ec-ed328d627362 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:17.628172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51976f-f8c7-444a-b8ec-ed328d627362 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:17.628448 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51976f-f8c7-444a-b8ec-ed328d627362 None None] PATH_INFO: `/v3` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:17.628796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c57369e9c0 pid: 87534 (default app) Jul 15 21:43:17.632947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Fri Jul 15 21:43:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:25.590408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:25.591343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:25.591343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:25.598770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:25.605667 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:25.606149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:25.606265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:25.690248 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: INFO dbcounter [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] Registered counter for database keystone Jul 15 21:43:25.714900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG oslo_db.sqlalchemy.engines [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 21:43:25.722963 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writer thread running {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 21:43:25.902219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG passlib.handlers.bcrypt [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87535) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 21:43:25.902666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG passlib.handlers.bcrypt [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87535) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 21:43:25.958297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:25.959937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:26.092865 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 21:43:26.258587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:26.346981 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: INFO dbcounter [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] Registered counter for database keystone Jul 15 21:43:26.368758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG oslo_db.sqlalchemy.engines [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 21:43:26.376962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writer thread running {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 21:43:26.501056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee6a1-8867-464c-ba71-0c1376c62c14 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:26.510859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:26.511832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:26.512305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:26.512763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:26.525695 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:26.578226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 21:43:26.578576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aa7db-32d9-4c69-be32-297c6b5878ed admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:26.589300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Jul 15 21:43:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 21:43:26.596450 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:26.618825 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa53b05-3a0b-444a-92fb-b1ec18bfb1f4 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:26.624867 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:26.626252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:26.626575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:26.626854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] PATH_INFO: `/v3/projects/f982803038e141998f61945f94c1d197` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:26.628608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f982803038e141998f61945f94c1d197)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:26.683353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING keystone.common.rbac_enforcer.enforcer [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 21:43:26.683671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d868cf-02ae-4d32-953d-468ddbeec8f8 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:26.688417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Jul 15 21:43:26 2022] GET /identity/v3/projects/f982803038e141998f61945f94c1d197 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:28.869939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716144-a8fc-484b-973e-adcce9376714 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:28.870826 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716144-a8fc-484b-973e-adcce9376714 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:28.870826 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716144-a8fc-484b-973e-adcce9376714 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:28.877738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:28.884530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:28.884968 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:28.885104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:28.913933 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:28.916590 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:28.931159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 21:43:28.955633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9716144-a8fc-484b-973e-adcce9376714 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:28.972642 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9716144-a8fc-484b-973e-adcce9376714 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:28.978079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:28.978723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:28.979010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:28.979290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:28.987664 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:28.989466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac7dc1-fde1-4b11-9690-c6a815e2f793 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:28.998800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Jul 15 21:43:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 21:43:29.008376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:29.023487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3acfe-5626-48d7-bec9-ff2e3437bc99 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:29.029402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:29.030675 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:29.030961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:29.031237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:29.032817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:29.034728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca500-1d6b-490f-92d5-5cf15551af2b admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:29.036322 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Fri Jul 15 21:43:29 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:31.341429 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac91-e476-4678-be4d-5c3036f40a9b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.342051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac91-e476-4678-be4d-5c3036f40a9b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.342051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac91-e476-4678-be4d-5c3036f40a9b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.343615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:43:31.348619 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.349096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.349185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.365915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535635-855b-411f-b5d2-0f851afc92c8 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.366104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:31.366383 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535635-855b-411f-b5d2-0f851afc92c8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.366476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535635-855b-411f-b5d2-0f851afc92c8 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.367296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:31.367795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:31.372630 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.372912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.373190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.413929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG passlib.handlers.bcrypt [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87534) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 21:43:31.414358 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG passlib.handlers.bcrypt [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87534) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 21:43:31.448166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:31.459436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:31.461033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:31.472179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:31.495919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:31.561709 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:31.584970 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:31.692600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aef27-d8e3-4c5b-b4fc-17befc10262a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:31.694562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b80d-3149-4902-b445-d56ebbef3739 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:31.696923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:31.729030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:31.729832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.730153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.730434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.731958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:31.732862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.733146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.733421 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.742318 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:31.753624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:31.754686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:31.755531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:43:31.761217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:31.805688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:31.807641 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:31.844950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:31.863554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06feab-7f65-4a87-bc7e-befbd5f39528 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:31.898568 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:31.899240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:31.899524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:31.899784 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:31.900534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:31.900849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:31.902295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:31.908590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:43:31.915157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:31.916038 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 8/16] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:31.918444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:31.921677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:32.023481 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593d274-d01e-427d-8707-2dd60a836da8 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:32.030477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e666-dc1d-4e05-92f1-f9f9b9534e8a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:32.058311 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:32.059112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:32.059395 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:32.059673 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:32.065382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:32.066293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:32.066589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:32.066864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:32.068101 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:32.069807 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:32.071464 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:31 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:32.077048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:32.078015 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:32.079472 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:32.092307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:43:32.101261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:32.102329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:32.103343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:43:32.103343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:43:32.103343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:43:32.103343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:32.103343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:43:32.109652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:32.168022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:32.181445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97a42-9a31-4c96-b95c-94f0ccdf9cf6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:32.217517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:32.218365 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:32.218649 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:32.218907 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:32.220218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:32.221700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:32.223409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:32.230010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:32.316438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:32.334935 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759590c-90d7-41b6-a431-a1b1afbe9109 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:32.340461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5229-d4c8-48a2-8af8-ad410e91f1a5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:32.373878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:32.374578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:32.374863 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:32.375138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:32.375901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:32.376211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:32.376301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:32.376932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:32.377218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:32.377501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:32.377653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572717-3e0b-4ba9-8c7f-dac3cc5656d4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:32.378449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.domain.id=default, user.id=d7948ce1e03b4c18a198a75488650567) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:32.378767 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:32.380201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239ed8-c245-4d76-ab8e-453fa708917f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:32.387905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Fri Jul 15 21:43:32 2022] GET /identity/v3/role_assignments?user.id=d7948ce1e03b4c18a198a75488650567&scope.domain.id=default&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:32.396505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:35.172795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b705ee-f7e5-49f5-b6ab-b02ac1c6844a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.173854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b705ee-f7e5-49f5-b6ab-b02ac1c6844a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.174369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b705ee-f7e5-49f5-b6ab-b02ac1c6844a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.175988 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:35.182746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f834ac-4cda-44d4-97db-b6b333d76876 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.183665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f834ac-4cda-44d4-97db-b6b333d76876 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.184140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f834ac-4cda-44d4-97db-b6b333d76876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.203948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-a0f834ac-4cda-44d4-97db-b6b333d76876 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:35.205537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-a0f834ac-4cda-44d4-97db-b6b333d76876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:35.283743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:35.309994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b705ee-f7e5-49f5-b6ab-b02ac1c6844a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:35.440051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b705ee-f7e5-49f5-b6ab-b02ac1c6844a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:35.460767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323e96-963d-437b-b307-335e99359980 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.461416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323e96-963d-437b-b307-335e99359980 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.461956 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323e96-963d-437b-b307-335e99359980 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.463552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:43:35.469069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ca6-2bac-4824-bafd-ecfa5a769034 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.469597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ca6-2bac-4824-bafd-ecfa5a769034 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.470129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ca6-2bac-4824-bafd-ecfa5a769034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.496616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c2544ca6-2bac-4824-bafd-ecfa5a769034 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:35.499201 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c2544ca6-2bac-4824-bafd-ecfa5a769034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:35.517366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:35.518565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.519074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.519545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.533167 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-9ad782a3-b392-4046-a143-d4fbe2dfc9e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:35.543075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:35.543946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:35.544690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:35.547416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 13/25] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:35.548882 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188192bd-d319-43b2-bf13-10ab1026ad9d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.549834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188192bd-d319-43b2-bf13-10ab1026ad9d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.554025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188192bd-d319-43b2-bf13-10ab1026ad9d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.556011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 14/26] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:35.559896 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188192bd-d319-43b2-bf13-10ab1026ad9d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:35.564667 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:35.611898 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:35.652652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 13/27] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:43:35.654012 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.654306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.654587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.699201 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:35.700339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:35.719103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188192bd-d319-43b2-bf13-10ab1026ad9d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:35.783733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:35.784416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:35.784960 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:35.785242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:35.786037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:35.786349 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:35.788046 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:35.805957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 15/28] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:35.808232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:35.835369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 14/29] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:35.842247 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:35.957124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:35.993851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d63a-f386-4bdc-8ee3-5ae64c75152e None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.003998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:36.024227 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55e31-eb5b-4b3e-9575-2ca2f5b691d5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.040806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.042758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.043259 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.043714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.046137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.047824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.050527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 15/30] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:35 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:36.052241 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.063748 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.064685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.065062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.065408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.077449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.079073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c844b6fc-3afb-447b-b4b8-8b77c95f7cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:43:36.098482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:36.099369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:36.100746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:43:36.100746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:43:36.100746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:43:36.100746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:36.100746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:36.101894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8c41-e24b-4af6-841f-bf3f1d04bacf None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.102304 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8c41-e24b-4af6-841f-bf3f1d04bacf None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.102644 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8c41-e24b-4af6-841f-bf3f1d04bacf None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.104259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 17/32] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:36.104835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8c41-e24b-4af6-841f-bf3f1d04bacf None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.202630 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d54a6-e2de-4217-be09-6b092590cf9f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.235131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8c41-e24b-4af6-841f-bf3f1d04bacf None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.247431 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.248430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.248897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.249341 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.250372 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.251944 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.255331 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:36.281392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.282631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.283197 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.283694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.285670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.287671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef1e54-31cd-40f1-97c9-695cde675b52 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.290751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 18/33] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:36.292561 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.293166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.293681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.322990 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:36.328013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:36.428137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 16/34] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Jul 15 21:43:36 2022] POST /identity/v3/roles => generated 219 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:36.436017 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.510345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:36.510513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 19/35] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:36.511356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.627697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53f33-6f47-40cc-8790-1882351cce1f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.671172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596cf02-8ba4-4854-9f73-570f7f544b3b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.681785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.682841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.683241 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.683490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.684153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:36.684468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.686046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.693142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:36.703037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 17/36] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:36.704092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.722058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.723903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.724378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.724739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] PATH_INFO: `/v3/domains/default/users/d7948ce1e03b4c18a198a75488650567/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.727110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d7948ce1e03b4c18a198a75488650567, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.728593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284b801-cccd-4589-a4a6-14305b597f43 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.804383 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:36.811670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118556fe-7a5c-476e-bcd0-26a060a79cab None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:36.847419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:36.848076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.848368 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.848653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.849407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:36.850990 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc83b4-32e0-44ff-913e-204618c1b4fe None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:36.851513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 20/37] 10.222.0.17 () {58 vars in 1361 bytes} [Fri Jul 15 21:43:36 2022] PUT /identity/v3/domains/default/users/d7948ce1e03b4c18a198a75488650567/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:43:36.853312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648217-0c5f-4e79-90c8-5c624a29d471 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.853609 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648217-0c5f-4e79-90c8-5c624a29d471 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.853888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648217-0c5f-4e79-90c8-5c624a29d471 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.858355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 21/38] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:36.859192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648217-0c5f-4e79-90c8-5c624a29d471 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:36.872016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 18/39] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Jul 15 21:43:36 2022] POST /identity/v3/roles => generated 225 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:36.879918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d90d18-3aa0-465c-ac23-0bfd3cd616a3 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.880279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d90d18-3aa0-465c-ac23-0bfd3cd616a3 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.880504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d90d18-3aa0-465c-ac23-0bfd3cd616a3 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.883013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 19/40] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:36.887628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e002-1478-4066-bfd0-905f0f7e69c8 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:36.887628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e002-1478-4066-bfd0-905f0f7e69c8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:36.887628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42e002-1478-4066-bfd0-905f0f7e69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:36.908467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-ed42e002-1478-4066-bfd0-905f0f7e69c8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:36.910656 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-ed42e002-1478-4066-bfd0-905f0f7e69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:37.000017 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:37.001985 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:37.002305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:37.002600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:37.006653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648217-0c5f-4e79-90c8-5c624a29d471 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:37.022568 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:37.028664 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:37.064638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:37.065702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:37.066256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:37.066729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:37.067681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:37.069643 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:37.108884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:43:36 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:37.109611 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 21/43] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:37.110338 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:37.144768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:37.158591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:37.167568 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:37.278770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1233d1-961f-4f3b-afc4-73545b7e9e13 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:37.299314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5669-ae8f-41b6-9589-47fa5d96b6ec None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:37.319180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:37.320030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:37.320321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:37.320603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:37.321973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:37.323482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:37.325513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 23/44] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:37.331373 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:37.347919 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:37.349322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:37.350000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:37.350966 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:37.351918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:37.353651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260c55-4260-430b-b77d-6173beba2a13 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:37.376187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Jul 15 21:43:37 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:37.463561 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:37.470975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3eb45-1c28-4c3c-93a0-1c5fd5d27fef None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:37.512649 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:37.513338 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:37.513628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:37.513901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:37.514744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:37.516323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4976-2635-4646-a877-5e518bb5c4e4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:37.553892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:43:37 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:43:39.212611 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4aec6-5a34-40f5-831f-b6a4b592d084 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.213153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4aec6-5a34-40f5-831f-b6a4b592d084 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.213288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4aec6-5a34-40f5-831f-b6a4b592d084 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.214716 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 23/47] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:39.220247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.220670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.220819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.239484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:39.241768 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:39.313565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:39.338901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4aec6-5a34-40f5-831f-b6a4b592d084 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:39.425151 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:39.452309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4aec6-5a34-40f5-831f-b6a4b592d084 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:39.486931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:39.487662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.487945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.488220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.500003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:39.508812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:39.509685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:39.510702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 24/49] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:39.516065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:39.597225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:39.622971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31648c65-f52a-4a80-b04c-f6cb92ec1b26 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:39.663391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:39.664079 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.664368 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.664645 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.665381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:39.665720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:39.667168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693f17-0c4d-44ff-8074-a055c16cfaa0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:39.675659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 26/50] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:39.682369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:39.768122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c635d-0b06-4c30-b8b8-68ac19c83372 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.768289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c635d-0b06-4c30-b8b8-68ac19c83372 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.768583 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c635d-0b06-4c30-b8b8-68ac19c83372 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.770029 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 27/51] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:39.775025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.775314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.775592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.789226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c122-05e8-419f-9d09-348c6242fd4c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:39.793314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:39.794541 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:39.825050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:39.825968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.826259 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.826553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.827752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:39.829239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:39.830936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 25/52] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:39.837296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:39.840055 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:39.863190 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 28/53] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:39.886560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:39.944706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ca14-34d1-4cb5-becc-45ae231e534a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:39.956819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:39.980556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:39.981428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:39.981723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:39.982111 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:39.983406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:39.985042 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:39.986901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 26/54] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:39.992037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6563e3-d3e3-46a7-9d37-4decc6e74436 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:39.995056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:40.028424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:40.029202 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:40.029485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:40.029769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:40.031360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:40.032813 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:40.034465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 29/55] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:40.040139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:40.063866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:40.094266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769fab3-3dd0-4ba5-a698-108308bda238 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:40.128215 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:40.129223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:40.129223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:40.129409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:40.130391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.domain.id=default, user.id=d7948ce1e03b4c18a198a75488650567) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:40.130702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:40.132191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e276155-bfb0-415d-aa78-b1a955fba897 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:40.140715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 27/56] 10.222.0.17 () {56 vars in 1322 bytes} [Fri Jul 15 21:43:39 2022] GET /identity/v3/role_assignments?user.id=d7948ce1e03b4c18a198a75488650567&scope.domain.id=default&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:40.141414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486089f5-2557-4433-8202-acc3d99bb3a8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:40.177847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:40.178588 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:40.178889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:40.179282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:40.180019 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:40.181555 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950413e-6353-4840-9dc4-e6df504ee5b4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:40.190699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:40.210815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 30/57] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Jul 15 21:43:40 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:42.465691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365265-c419-448c-8a73-93a22190e77b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:42.466571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365265-c419-448c-8a73-93a22190e77b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:42.466707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12365265-c419-448c-8a73-93a22190e77b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:42.468916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 28/58] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:42.474550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:42.475395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:42.475395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:42.494075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:42.495259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:42.564838 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 31/59] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:43:42.591363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12365265-c419-448c-8a73-93a22190e77b None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:42.698560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12365265-c419-448c-8a73-93a22190e77b None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:42.736120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:42.736903 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:42.737189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:42.737466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:42.738780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:42.740270 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ca101-d52f-4b7b-bbf7-0eeb4e1293fa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:42.741895 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 29/60] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:42.750868 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:42.863430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0ecd-3356-4f66-a8b0-339e692e88ed None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:42.886383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:42.909878 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:42.910869 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:42.911278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:42.911661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:42.912762 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:42.914402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b882b-7e18-494f-a1c6-96fa0904b8dc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:42.943031 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 32/61] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:43:42 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:46.549694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1c76-5b9c-4d06-ace9-116b3c3b8df1 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.549694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1c76-5b9c-4d06-ace9-116b3c3b8df1 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.549694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1c76-5b9c-4d06-ace9-116b3c3b8df1 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.550675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 30/62] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:46.556757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.557720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.558233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.582956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:46.584614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:46.640706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1b34-d13a-4ab4-bd50-b2b97c6c8589 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.641319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1b34-d13a-4ab4-bd50-b2b97c6c8589 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.641660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1b34-d13a-4ab4-bd50-b2b97c6c8589 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.643527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:46.650443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477fcc-a4f0-4549-acb3-20e32109dc36 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.651355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477fcc-a4f0-4549-acb3-20e32109dc36 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.652087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477fcc-a4f0-4549-acb3-20e32109dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.665893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 33/64] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:46.668553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:46.691073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c4477fcc-a4f0-4549-acb3-20e32109dc36 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:46.692335 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c4477fcc-a4f0-4549-acb3-20e32109dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:46.732759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:46.775834 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 32/65] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:46.777297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773de7-9ba7-436c-9613-339601c77f2a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.777590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773de7-9ba7-436c-9613-339601c77f2a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.777887 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773de7-9ba7-436c-9613-339601c77f2a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.779169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 33/66] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:46.784884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.785336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.785784 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.803195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:46.804601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:46.857467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152f14-9e4c-46ff-9c99-7120b800899a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:46.869854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:46.883044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 34/67] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:43:46.889893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:46.924468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:46.925595 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:46.926077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:46.926529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:46.940944 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:46.950289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:46.951239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:46.951998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:46.954524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 34/68] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:43:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:46.958842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:46.972197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.015061 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e29f-b405-4e9e-9a27-bea2c1c61d35 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.054952 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.055769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.056055 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.056331 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.067731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:47.070315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c85b3-deae-4798-b5a0-83b208aed401 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:47.075573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:47.076416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:47.077657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:47.078871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.105684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.106521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.106812 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.107093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.117298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-cbcc1c37-d43a-40f4-a709-a095f33c17f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:47.124860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:47.125986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:47.126747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 35/70] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:47.127455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68093-8855-4938-b51d-f2f0b50abf4b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68093-8855-4938-b51d-f2f0b50abf4b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf68093-8855-4938-b51d-f2f0b50abf4b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 36/71] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b55156-f3f5-4049-8854-b4f46e298558 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b55156-f3f5-4049-8854-b4f46e298558 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.132400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b55156-f3f5-4049-8854-b4f46e298558 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.132776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 37/72] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:47.133240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b55156-f3f5-4049-8854-b4f46e298558 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.161139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.188675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8690-8c5d-47e8-bad7-18b97967655f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.211239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.223165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.223844 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.224131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.224409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.225251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:47.225646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.227092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.236573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b55156-f3f5-4049-8854-b4f46e298558 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.239014 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.240982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.270404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.271077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.271371 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.271709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.272478 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:47.272786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.274220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc442412-133b-4f2b-9075-c6bf18753d23 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.282583 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 38/74] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.287381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff687-0898-4f10-9a87-0ec151507963 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.287381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff687-0898-4f10-9a87-0ec151507963 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.287381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff687-0898-4f10-9a87-0ec151507963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.301256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-fbcff687-0898-4f10-9a87-0ec151507963 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:47.302480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-fbcff687-0898-4f10-9a87-0ec151507963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:47.348162 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c53c-78aa-47e4-96b4-0e6fc9f8025c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.379656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 39/75] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:47.381593 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.382013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.382302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.382396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455720f0-664b-415d-876a-ffcfef607823 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.382589 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.382682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455720f0-664b-415d-876a-ffcfef607823 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.382865 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455720f0-664b-415d-876a-ffcfef607823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.383327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:47.383636 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.385203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.400150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 37/76] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.401027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.406747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-455720f0-664b-415d-876a-ffcfef607823 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:47.407951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-455720f0-664b-415d-876a-ffcfef607823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:47.421672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.452099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.475179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 40/77] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:47.476032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455720f0-664b-415d-876a-ffcfef607823 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.513421 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17c95-8c8e-481b-bdcd-fc8a21379716 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.548768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.549659 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.549980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.550546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.565546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.567088 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.568832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 38/78] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.569853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.575814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455720f0-664b-415d-876a-ffcfef607823 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.610738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.611634 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.611916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.612183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.613418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.614905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.616892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 41/79] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.617654 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.635815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.672471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea539-03b2-488c-a5e7-c4786c75fd0d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.674955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.708206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.709019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.709401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.709689 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.721351 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc432-db91-4fe5-945c-78707c06911f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.722646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:47.734519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:47.735423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:47.736179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:47.736758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 39/80] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:47.737298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.761838 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.762749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.763045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.763296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.764502 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.766006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.767655 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 42/81] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.772608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.842221 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f7da-f092-4c3b-94de-82d4570e4681 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.852060 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.869682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b4e0-431b-42c7-a689-446592a6046a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:47.878722 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.879543 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.879833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.880122 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.881546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.883087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.889428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 40/82] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:47.889428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:47.903328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:47.903978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:47.904263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:47.904544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:47.920289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:47.980510 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:47.982496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:47.997201 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d70e6-5357-4238-9b10-238fffddcb46 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.033611 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.034414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.034706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.035092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.077356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.094469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 43/83] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:43:48.095392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.117795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.119326 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.149719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.195079 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c98d6-4c6c-4305-bb86-f80922915334 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.219958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 41/84] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:43:48.220880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.231211 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.231829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.232104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.232387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.233172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:48.233487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.234934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.243969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 44/85] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.244631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.294059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.329147 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb820e5-84aa-4b3f-a889-e4f6e2b9c63c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.348438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9554-a643-4d9d-83c9-f4a41aa4bd0b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.362899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.369163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.370281 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.370581 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.370842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.384910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.385893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.386208 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.386496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.387231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.388703 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.425901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 45/86] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:43:48 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:48.425901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.470448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.472024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.536695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02c8e-8dbc-4c50-b802-5b786284a0b9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.538511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.578245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.579145 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.579439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.579729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.581566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.583094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.585204 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 46/87] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.590819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.596546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 42/88] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:43:48.597415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.630168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.717073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d7f4-f423-4538-bf0b-3a431a6df100 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.725132 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d5a7-e97c-435a-8704-c9cf1a32fb33 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.764070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.765054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.765434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.765740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.767584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.768884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.771002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 47/89] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.771119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.775836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.776281 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.776577 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.776862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.779075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.780934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.782811 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 43/90] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.783517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.828489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.903974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:48.907534 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9b52-8488-4822-936f-88b7d0de573e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.907910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ffcca-6aee-433c-b7ec-2828787727cc None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:48.953091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.954085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.954379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.954906 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.956135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.957597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.959334 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:48.959475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 44/91] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.964919 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:48.965692 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:48.967285 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:48.967776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:48.968856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] RBAC: Adding query filter params (role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:48.969380 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:48.971122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:48.980793 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 48/92] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:48.982108 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:49.125283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464859-3f2b-4a4b-a2b5-ebfcbfbe8397 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:49.195526 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:49.196200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:49.196486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:49.196762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:49.197605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:49.198216 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:49.199488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:49.203724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b23a-fb8f-4317-85e3-91a2f13677b9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:49.205473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:49.206466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 45/93] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:49.214671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:49.244871 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:49.245935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:49.246451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:49.246982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:49.295014 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:49.325290 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:49.327379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:49.439645 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 49/94] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:43:49.446872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:49.449325 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:49.477165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14966-4d18-4c36-bec1-5e780f9faebc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:49.554708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:49.555364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:49.555806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:49.556087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:49.556936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=d7948ce1e03b4c18a198a75488650567) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:49.557388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:49.558946 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:49.561561 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94df90-aaa9-4516-a30d-6a0687de7fa6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:49.572436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 46/95] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:49 2022] GET /identity/v3/role_assignments?user.id=d7948ce1e03b4c18a198a75488650567&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:49.612082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:49.613682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:49.614195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:49.614683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] PATH_INFO: `/v3/projects/4f2f7b3134754e19bc0b25e2efe60137` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:49.616382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] RBAC: Authorizing `identity:get_project(project_id=4f2f7b3134754e19bc0b25e2efe60137)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:49.618174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d229a0-0f57-4ccd-8ece-22212adf68b7 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:49.620223 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 50/96] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:49 2022] GET /identity/v3/projects/4f2f7b3134754e19bc0b25e2efe60137 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:49.626587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:49.781579 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:49.788787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430056-e901-405f-b1b8-73743aa293eb None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:49.846606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:49.847430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:49.847719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:49.847998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:49.848846 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=4f2f7b3134754e19bc0b25e2efe60137, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:49.849162 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:49.850688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76b56-dfce-422f-b2d3-c50c26d2d323 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:49.859239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 47/97] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:49 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=4f2f7b3134754e19bc0b25e2efe60137&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:51.356036 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e01-c0f8-4579-a20b-44de554121f2 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:51.357125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e01-c0f8-4579-a20b-44de554121f2 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:51.357625 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e01-c0f8-4579-a20b-44de554121f2 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:51.359335 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 51/98] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:51.365337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:51.365999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:51.365999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:51.391018 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:51.392265 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:51.505590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 48/99] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:51.529571 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b462c-e0ac-4106-b18b-c8f9413044f7 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:51.530354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b462c-e0ac-4106-b18b-c8f9413044f7 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:51.530710 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b462c-e0ac-4106-b18b-c8f9413044f7 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:51.530932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:51.532501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 52/100] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:51.537470 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:51.537899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:51.538289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:51.561115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:51.562363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:51.648340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:51.663477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282c065-6996-42f8-ae8a-417a09f20575 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:51.691249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:51.697903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 53/101] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:51.735517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:51.736325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:51.736614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:51.736826 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:51.736932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:51.738119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:51.739595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:51.741548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 49/102] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:51.748380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:51.964200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826aed9-c343-4a02-b43f-d477333baa1d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:51.992474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456384-1763-4486-9a09-ccdaa6a6fe4c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.043278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.044142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.044428 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.044705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.061801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:52.074379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:52.075321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:52.076109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 54/103] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:43:52.083012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.123197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.123897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.124181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.124458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.125189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:52.126757 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b758-5916-443e-b8e6-df1aafedb231 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:52.196309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 50/104] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:43:51 2022] POST /identity/v3/projects => generated 302 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:43:52.197677 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad5e-2ed0-42c9-8ea6-6ae76f0345c0 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.198044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad5e-2ed0-42c9-8ea6-6ae76f0345c0 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.198300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad5e-2ed0-42c9-8ea6-6ae76f0345c0 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.199554 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 51/105] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:52.207504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.207794 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.208081 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.226431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:52.247437 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:52.249719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:52.262255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:52.290990 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f84f0-d804-402d-8acf-77f9c0b2b723 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.348904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.350191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.351024 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.351549 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.352497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:52.352998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:52.354605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:52.361886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 52/106] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:52.373289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 55/107] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:52.378955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.390479 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.527670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508283-7ac5-47bb-91ab-7f0cf99ac9d1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.553796 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:52.566394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.567231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.567581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.567863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.579938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:52.588783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:52.589676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:52.590475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 56/108] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:52.596533 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.631772 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e69d5-afab-4b23-bc66-e409e52213b0 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.695258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.696255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.696546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.696824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] PATH_INFO: `/v3/users/8a115be5c68c40c0aa4241ab3614740b` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.704516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17916-783c-424f-8989-471b857f0518 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.714226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:52.719182 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] RBAC: Authorizing `identity:get_user(user_id=8a115be5c68c40c0aa4241ab3614740b)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:52.723468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:52.725740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 53/109] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/users/8a115be5c68c40c0aa4241ab3614740b => generated 289 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:52.731045 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.742359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.743048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.743385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.743678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.744492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:52.744810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:52.746306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:52.762457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 57/110] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:52.771739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:52.846378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:52.886242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e06d7-8507-4593-92fe-05db494d713a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.902268 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e284c-9e77-4d7a-aef6-92df6405c816 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:52.937109 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.937795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.938120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.938404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.965030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:52.968002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:52.968287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:52.968574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:52.970316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:52.974785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:52.974785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 58/111] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:52.985846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.169918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.178424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:53.180373 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67158b22-fb93-4181-acd6-9184799bc75e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:53.237359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e354079-ad7d-4c81-8526-3815529673d0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.254324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.280700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:53.281765 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.282179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.282562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.284052 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:53.285662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4451f-4a33-48fa-a6f8-8d331d170af2 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:53.291783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 59/112] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:53.291783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ee56-6964-47b4-a23c-0f69c9d2fe75 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.291783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ee56-6964-47b4-a23c-0f69c9d2fe75 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.291783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ee56-6964-47b4-a23c-0f69c9d2fe75 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.291783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 60/113] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:53.294180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5d56-7d06-40a1-ba11-6bd1d035ae98 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.294180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5d56-7d06-40a1-ba11-6bd1d035ae98 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.294180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5d56-7d06-40a1-ba11-6bd1d035ae98 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.299382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 61/114] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:53.302384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec5d56-7d06-40a1-ba11-6bd1d035ae98 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.364289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 54/115] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:43:53.367324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f65-b688-4de0-9d37-66d918e07d27 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.367778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f65-b688-4de0-9d37-66d918e07d27 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.368198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f65-b688-4de0-9d37-66d918e07d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.390355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-bcad1f65-b688-4de0-9d37-66d918e07d27 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:53.391311 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-bcad1f65-b688-4de0-9d37-66d918e07d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:53.463691 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec5d56-7d06-40a1-ba11-6bd1d035ae98 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.476797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 55/116] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:53.477955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4313-71bb-4b56-948b-94df93dde8cb None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.478250 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4313-71bb-4b56-948b-94df93dde8cb None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.478528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4313-71bb-4b56-948b-94df93dde8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.499883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e5be4313-71bb-4b56-948b-94df93dde8cb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:53.501144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e5be4313-71bb-4b56-948b-94df93dde8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:53.523531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:53.524433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.524816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.525254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/0aa203eae9c740c5bffcbdf92d4b5712` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.528839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, user_id=9eecf3fed1cc42fbb6133c4ef3971e4a, role_id=0aa203eae9c740c5bffcbdf92d4b5712)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:53.529303 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.531600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:53.548901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 62/117] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:43:53 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/0aa203eae9c740c5bffcbdf92d4b5712 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:43:53.551265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.590544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 56/118] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:53.598309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d7e4-dfc1-4c90-8481-5cb6b38bbb24 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.598865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d7e4-dfc1-4c90-8481-5cb6b38bbb24 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.599338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d7e4-dfc1-4c90-8481-5cb6b38bbb24 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.605737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.606570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 57/119] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:53.608097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d7e4-dfc1-4c90-8481-5cb6b38bbb24 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.677552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec005-f179-4676-99d7-759daa736b24 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.723355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:53.724444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.724602 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.724878 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.726699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:53.729348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0c854-95d0-418d-a85e-989c83d64556 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:53.736459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 63/120] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:53 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:53.736459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.736459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.736459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.750656 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d7e4-dfc1-4c90-8481-5cb6b38bbb24 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.755693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:53.757555 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:53.789796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:53.791025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.791508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.792044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.803869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:53.812110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:53.812968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:53.813732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:53.816472 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 58/121] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:53.817535 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.834986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 64/122] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:53.836207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:53.851850 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.891949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:53.937384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941751-684a-4276-a0be-17c7a0a08654 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.964148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7afe-4445-4659-a196-3fcc42e0e9a0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:53.979270 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:53.980541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:53.981024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:53.981553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:53.993397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:54.002405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:54.003046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:54.003883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:54.004672 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:54.005271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.005271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.005271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.005271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=8a115be5c68c40c0aa4241ab3614740b) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:54.005271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.006582 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.007793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 59/123] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:54.013798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.018285 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 65/124] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:53 2022] GET /identity/v3/role_assignments?user.id=8a115be5c68c40c0aa4241ab3614740b&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.019759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.114015 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.129789 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5dbc2-cce1-42e1-b0a1-3545d7a16610 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.170280 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.171466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.171951 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.172423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.173531 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:54.174118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.175852 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.186248 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 60/125] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.187550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.251438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df7c6-0d3e-461d-b928-c17268135c4a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.253618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.300782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.302303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.302303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.302303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.314491 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:54.322032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cca5e-eca6-4193-acf2-66a5f2a8bd7f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:54.324174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:54.325020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:54.325797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 66/126] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:54.326474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.361579 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.362833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.363475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.363963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.364960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:54.365517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.367333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.376495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 61/127] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.377720 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.385629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.444921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84f38-006b-4791-8bc4-ee8b3fc342e2 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.483770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.484884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.485252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.485532 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.486858 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.488572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.490771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 67/128] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.491578 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.499376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1050-362c-493c-bb24-accce5c5cf1e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.526581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.538851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.539915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.540394 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.540958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.541947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:54.542540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.544152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.554074 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 62/129] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.555296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.606562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9ec1-b651-49d5-b511-b1388c0c478d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.631796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.646445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.646445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.646445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.646445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.648201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.649802 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.651797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 68/130] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.652599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.735639 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338314-9c13-4a25-bc93-9d18ff4083cc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.761670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f9be6-bc12-4a03-94d1-614179a9fcae None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.766242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:54.799460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.800319 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.801059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.801059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.802245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.804022 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.806016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 69/131] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.806929 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.855191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.856093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.856392 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.856674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.857930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.859397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.861121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 63/132] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.862982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:54.912845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c278ec-2715-4fa0-8263-0f14aa8894e8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:54.949770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:54.950707 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:54.950998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:54.951282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:54.952586 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:54.954188 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:54.956457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 70/133] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:54.957233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:55.002439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:55.056881 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaad95-e301-4c25-b72e-d566b2e5a8d9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:55.070860 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1a8d-2995-4622-a925-79b317619ff8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:55.119683 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:55.127666 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:55.128575 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.128856 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.129145 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] PATH_INFO: `/v3/projects/4f2f7b3134754e19bc0b25e2efe60137` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.135336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] RBAC: Authorizing `identity:get_project(project_id=4f2f7b3134754e19bc0b25e2efe60137)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:55.136831 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:55.138814 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 64/134] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:54 2022] GET /identity/v3/projects/4f2f7b3134754e19bc0b25e2efe60137 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:55.139396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:55.151143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:55.152064 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.152357 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.152647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/d7948ce1e03b4c18a198a75488650567/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.160783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, user_id=d7948ce1e03b4c18a198a75488650567, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:55.162366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:55.191092 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 71/135] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:43:54 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/d7948ce1e03b4c18a198a75488650567/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:43:55.191931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:55.339671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0cbd4-01a0-44a0-affb-ef973bbbd581 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:55.384240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:55.398693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147372ea-4e3f-4fbe-89e4-70b10b3b1d2b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:55.417114 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:55.418134 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.418424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.418707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.420731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, user_id=9eecf3fed1cc42fbb6133c4ef3971e4a, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:55.422261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e97a7-f44e-4b46-b3ff-c7d08c83586a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:55.443773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 65/136] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:43:55 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:43:55.445662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594e0f-6a7d-49c3-ab02-c7e65afa7d69 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.446212 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594e0f-6a7d-49c3-ab02-c7e65afa7d69 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.446686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594e0f-6a7d-49c3-ab02-c7e65afa7d69 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.447554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:55.448477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.448737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.449034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] PATH_INFO: `/v3/projects/4f2f7b3134754e19bc0b25e2efe60137/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.449225 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 66/137] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:55.452563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f2f7b3134754e19bc0b25e2efe60137, user_id=9eecf3fed1cc42fbb6133c4ef3971e4a, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:55.452563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:55.454282 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.454771 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.455598 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.472264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 72/138] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:43:55 2022] PUT /identity/v3/projects/4f2f7b3134754e19bc0b25e2efe60137/users/9eecf3fed1cc42fbb6133c4ef3971e4a/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:43:55.482659 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:55.484222 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:55.580204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:55.595466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:55.640612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:55.785303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8a80-fc03-41b9-97d7-4a4480d0f3f5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:55.821312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:55.822206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:55.822792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:55.823070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:55.824269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:55.825755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7671d-eb7c-4413-bd6c-545fbe28da5e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:55.827772 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 73/140] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:55.833499 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:55.985936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2333-39c5-435d-98d7-9bf7f04f19e5 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:56.035544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:56.036243 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:56.036533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:56.036813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:56.037567 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:56.039080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452820-ff01-4b7b-aabd-b57dd09c0030 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:56.087413 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 68/141] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:43:55 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:43:56.591818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279556-b4f7-49f3-b55b-8b48917027c0 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:56.592206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279556-b4f7-49f3-b55b-8b48917027c0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:56.592413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279556-b4f7-49f3-b55b-8b48917027c0 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:56.594116 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 74/142] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:56.599107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:56.599593 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:56.599759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:56.626006 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:56.627227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:56.681578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:56.714443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 69/143] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:56.753564 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279556-b4f7-49f3-b55b-8b48917027c0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:56.792868 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:56.894812 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279556-b4f7-49f3-b55b-8b48917027c0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:56.943842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:56.944589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:56.944873 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:56.945150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:56.960383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-925b7eed-72fb-4b07-9b0e-39b266a692ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:56.968476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:56.969407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:56.970233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 75/144] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:43:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:56.977385 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.095680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be99007-d3c1-4018-bbe6-ac6a14675f0b None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:57.114658 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560019-aa00-4e92-b810-6c4e53bc31c8 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.114967 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560019-aa00-4e92-b810-6c4e53bc31c8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.115245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560019-aa00-4e92-b810-6c4e53bc31c8 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.116652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 76/145] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:43:57.123181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.123467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.123745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.148482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:57.149712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:57.166595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:57.167295 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.167583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.167867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.168639 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:57.168948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:57.170416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:57.185621 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 70/146] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:57.202996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.272870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:57.292261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 77/147] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:43:57.345794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.358037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684588d-32d6-4789-a2c6-b2b20a32506f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:57.374591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:57.434670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:57.435586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.435869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.436148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.438682 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:57.440141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:57.442116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 71/148] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:57 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:57.450001 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.562259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b746-aebd-40d9-81d1-889eaa1a1c2f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:57.653415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:57.654269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.654551 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.655224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.686899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:57.699272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:57.700194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:57.700965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 78/149] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:43:57.710767 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.720750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9bb1d-d333-459d-9122-efc6edbe1b45 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:57.728649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:57.772028 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:57.772792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:57.772989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:57.773254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:57.867119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:57.868541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:57.894261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:57.967859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0477-b52f-4c65-90a6-3ba3144005e6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:57.974900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 72/150] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:43:57.983305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:57.998086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:58.023206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.024480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.024769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.025045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.025810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:58.030501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.032264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.043272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 79/151] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:58.049133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:58.234350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095659c1-b155-4ce3-ba6b-c350b1e1597d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:58.248808 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a9b13-6c2c-41ee-a49f-5ef7a2c1b0d3 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:58.307195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.308098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.308382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.308657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.314683 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.316316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.318561 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 73/152] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:57 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:58.319398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.319830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.320114 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.320391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] PATH_INFO: `/v3/users/8a115be5c68c40c0aa4241ab3614740b` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.322514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] RBAC: Authorizing `identity:get_user(user_id=8a115be5c68c40c0aa4241ab3614740b)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.323967 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.325899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 80/153] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:43:58 2022] GET /identity/v3/users/8a115be5c68c40c0aa4241ab3614740b => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:43:58.326609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:58.331745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:58.340493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:58.458267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:58.474204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd0b01-ef9e-458d-914c-e56cd6750605 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:58.533249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b08f-84d6-47fe-8d5f-a3e72661937a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:58.589498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.590417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.590702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.590975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.594582 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.596070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.597790 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 81/154] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:43:58 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:58.602807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.603504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.603796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.604078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.604940 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] RBAC: Adding query filter params (role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:43:58.605258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.606743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b380-c0de-4814-b93a-c7064ff4f7c8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.611994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:58.620613 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 74/155] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:43:58 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:43:58.690565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:58.731126 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af7a8-f982-49d1-8c10-7f2ff517ede8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:58.782123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:58.783056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:58.783399 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:58.783612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/8a115be5c68c40c0aa4241ab3614740b/roles/88a609cbdd6a4ca1b41b2eccd795e57c` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:58.785667 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, user_id=8a115be5c68c40c0aa4241ab3614740b, role_id=88a609cbdd6a4ca1b41b2eccd795e57c)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:43:58.787206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ac41-8723-4476-b9cc-6643f9aaf25d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:43:58.811650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 82/156] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:43:58 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/users/8a115be5c68c40c0aa4241ab3614740b/roles/88a609cbdd6a4ca1b41b2eccd795e57c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:43:59.313841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923240-a017-427c-b997-b5adf3247cc7 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.314377 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923240-a017-427c-b997-b5adf3247cc7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.314480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923240-a017-427c-b997-b5adf3247cc7 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.316103 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 75/157] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:59.321370 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501e31-812c-4bc4-811d-3bc664b62d90 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.321823 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501e31-812c-4bc4-811d-3bc664b62d90 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.322119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501e31-812c-4bc4-811d-3bc664b62d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.335762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdfd98-94de-4853-b81c-37817ac6d5de None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.336072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdfd98-94de-4853-b81c-37817ac6d5de None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.336328 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdfd98-94de-4853-b81c-37817ac6d5de None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.337737 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 76/158] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:43:59.344304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.344762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.344998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-54501e31-812c-4bc4-811d-3bc664b62d90 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:59.345099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.346217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-54501e31-812c-4bc4-811d-3bc664b62d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:59.376745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:59.377999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:59.445572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 83/159] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:59.466182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4182c-e671-4e82-98da-44555dadd564 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.466474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4182c-e671-4e82-98da-44555dadd564 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.466752 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4182c-e671-4e82-98da-44555dadd564 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.468390 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 84/160] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:43:59.473844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.474152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.474456 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.506965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:43:59.508174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:43:59.520407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 77/161] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:59.521744 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:59.591888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:59.616948 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 85/162] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:43:59.617839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:59.632220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:59.691136 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994eb0f-223c-4fd3-8942-d1ef3d724a03 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:59.748958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:59.750163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.750642 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.751108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.773144 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b518b3-1e7b-43f9-994b-747b709cecee None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:43:59.775182 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:59.788168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:59.789078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:43:59.789855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:43:59.792430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 78/163] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:59.796943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:59.834663 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:43:59.835576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:43:59.835861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:43:59.836133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:43:59.855298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:43:59.868558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:43:59.870034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 86/164] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:43:59.870848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:43:59.955037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:43:59.986210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae9880-ae5e-4e45-bbac-1c961db2ee10 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.031853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8333f5-fb45-49b3-b1c8-9cdfdaa9a774 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.032567 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:00.051972 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.052832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.053112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.053382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.079101 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:00.095370 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:00.096548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:00.098027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 79/165] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:00.099661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.100460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.100751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.101034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.101804 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:00.102159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.103579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.106820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.119516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 87/166] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.120382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.308670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610e0b-90ad-4144-8774-907bdf1d1739 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.332832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:00.352728 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0558e-cfd5-498a-a22f-c53a1bf91347 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.373756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.378874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.379324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.379744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.380679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:00.381187 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.382855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.410205 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 88/167] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.411392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.435154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.435858 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.436148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.436435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.437208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:00.437524 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.438979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.456563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 80/168] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.457436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.527113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:00.595795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e04f-a209-4949-a076-e9c1b4d9792a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.627950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ff66-c948-4219-891e-67c7ac20cad7 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.650234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.651153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.651443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.651726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.653063 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.654998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.657036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 81/169] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.657996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.703483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.704653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.705077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.705529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] PATH_INFO: `/v3/users/d7948ce1e03b4c18a198a75488650567` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.706942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] RBAC: Authorizing `identity:get_user(user_id=d7948ce1e03b4c18a198a75488650567)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.708565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.714928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 89/170] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/users/d7948ce1e03b4c18a198a75488650567 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.716010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.762798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0517-8e68-4bca-8cc4-cc87bdc812d2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.780837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:00.791735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:00.807119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.809168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.809454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.809731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] PATH_INFO: `/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:00.812072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] RBAC: Authorizing `identity:get_user(user_id=9eecf3fed1cc42fbb6133c4ef3971e4a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:00.816317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:00.818415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 82/171] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/users/9eecf3fed1cc42fbb6133c4ef3971e4a => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:00.819203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:00.907072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b843bc-3695-408c-9d38-d59c65ea49dd None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:00.986072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:00.986737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:00.987025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:00.987303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.023525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3041b3-1f0b-4690-866e-07387d60b948 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.094614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:01.095680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.096180 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.096675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.124221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.126181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671eb7-9975-4e02-a9a6-de0e5947e292 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.174303 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.182521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.184343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.216371 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.296104 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 83/172] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:01.297305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:01.305470 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 90/173] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:01.310975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba2df-b9be-4252-a05a-23cee90fa7e1 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.311267 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba2df-b9be-4252-a05a-23cee90fa7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.311547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba2df-b9be-4252-a05a-23cee90fa7e1 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.313014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 91/174] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:01.318975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac63d7-d321-47b5-99d7-6e7e78ae7ab9 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.319265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac63d7-d321-47b5-99d7-6e7e78ae7ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.319550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac63d7-d321-47b5-99d7-6e7e78ae7ab9 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.322269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 92/175] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:01.322376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac63d7-d321-47b5-99d7-6e7e78ae7ab9 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:01.405330 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.426936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad949-951a-4f45-8b3d-a187798289b9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.453891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac63d7-d321-47b5-99d7-6e7e78ae7ab9 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.477269 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:01.477971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.478264 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.478560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.495467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:01.496656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.497180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.497673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.499143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.500829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.502796 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 93/176] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:01.508680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:01.522111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.578062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.579860 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad473bfa-bc0a-40ab-9d38-043603665f0b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.622906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d9f0-647c-4206-8aeb-2773dce09f0c None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.668301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:01.669711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.670247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.670708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.672145 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.673803 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474530ea-27e7-4fa8-a543-90df70229433 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.681899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 94/177] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:01.683530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.684010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.684500 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.703540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.705352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:01.706817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:01.734341 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 84/178] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:01.735786 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.736082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.736363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.753739 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:01.754997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:01.786147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 95/179] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:01.787121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:01.804897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.835802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 85/180] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:01.836687 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:01.922671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704add1a-ccfe-4384-8518-d8d6fc996ba5 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.950615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea8d71-61bf-4c0b-bf14-b6273addea9c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:01.959831 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:01.960504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.960788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.961065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.961935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=d7948ce1e03b4c18a198a75488650567) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:01.962287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:01.963723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd029-528f-4c0a-9882-0fa8e8d67178 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:01.967483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:01.970175 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 96/181] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/role_assignments?user.id=d7948ce1e03b4c18a198a75488650567&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:01.971361 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549124a-2d0f-4fce-8c7d-f8d89b804a5b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:01.971723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549124a-2d0f-4fce-8c7d-f8d89b804a5b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:01.971906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549124a-2d0f-4fce-8c7d-f8d89b804a5b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:01.978262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 97/182] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:01.978262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549124a-2d0f-4fce-8c7d-f8d89b804a5b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.004076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.005139 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.005697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.006249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.007318 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:02.007931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.009777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.017424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 86/183] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.018752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.106305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.123924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549124a-2d0f-4fce-8c7d-f8d89b804a5b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.143977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bfcf3-63e7-4420-a63b-d048191a3446 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.167679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.168745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.169517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.169517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] PATH_INFO: `/v3/projects/4f2f7b3134754e19bc0b25e2efe60137` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.171050 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=4f2f7b3134754e19bc0b25e2efe60137)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.172653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.175097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 98/184] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:01 2022] GET /identity/v3/projects/4f2f7b3134754e19bc0b25e2efe60137 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.176061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.198740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.199572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.199845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.200325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.216490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e0323b79-bf39-4c8d-9fdf-fe279b86b3d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:02.225764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:02.226723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:02.227494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:02.228090 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 87/185] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:02.229333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da7a4-9826-4ce2-ba34-73eafa960c9d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.229510 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da7a4-9826-4ce2-ba34-73eafa960c9d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.230127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da7a4-9826-4ce2-ba34-73eafa960c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.249386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-d08da7a4-9826-4ce2-ba34-73eafa960c9d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:02.250606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d08da7a4-9826-4ce2-ba34-73eafa960c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:02.290326 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.300830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5fe1-1d17-4122-8bc1-c6b66cdca5f3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.328841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 88/186] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:02.330144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a1fa0-fc79-4378-ad81-a5571e670ce0 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.330320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a1fa0-fc79-4378-ad81-a5571e670ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.330688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a1fa0-fc79-4378-ad81-a5571e670ce0 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.331959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 89/187] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:02.332648 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a1fa0-fc79-4378-ad81-a5571e670ce0 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.344192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.345711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.346489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.346978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.357451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.360739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:02.370095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:02.371258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 99/188] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:02.376973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.448094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a1fa0-fc79-4378-ad81-a5571e670ce0 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.483011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c13a-108c-463b-b678-0b189fed20d1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.484228 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.484900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.485183 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.485460 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.486322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=4f2f7b3134754e19bc0b25e2efe60137, user.id=9eecf3fed1cc42fbb6133c4ef3971e4a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:02.486635 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.488127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab04485-e2a3-414d-959c-09172b8f3a72 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.494199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 90/189] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/role_assignments?user.id=9eecf3fed1cc42fbb6133c4ef3971e4a&scope.project.id=4f2f7b3134754e19bc0b25e2efe60137&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.503527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.503937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.504242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.520360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.521055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.521511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.521842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:02.522547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.523169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:02.523461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:02.523745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.525193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.535094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 100/190] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.535811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.562792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.613029 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.620179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 91/191] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:02.620179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.658078 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d46b-bd02-4e38-974f-19ef171cdee4 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.699641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.700451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.700729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.701003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.702857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.703686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.705312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 101/192] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.706095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.748147 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15cd24-d7c7-4bfd-b1a0-73391f2c9672 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.782118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.782798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.783081 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.783354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.784117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:02.784423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.785825 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.794003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 92/193] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.794604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.819191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a825ae-d8a0-455e-9f2a-f521aa303ba6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.821691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.852375 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:02.858664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.859554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.859835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.860117 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.873814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:02.875312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:02.877001 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 102/194] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:02.881915 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.894116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12abd-95db-49e2-b376-5396fee3e4f7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:02.929901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:02.929901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:02.929901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:02.929901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:02.940902 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:02.949402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:02.950428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:02.951217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 93/195] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:02.952273 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:02.978939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a5cd-ff79-47e9-9318-0045bb9e0491 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.014271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.015143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.015597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.015872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.016585 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.018073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.039082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 103/196] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:02 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:03.039937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.051538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.070203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4625-48a8-4d55-9440-1682ca386898 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.095320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.111934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.112945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.113296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.113645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.115411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.116593 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.118402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 94/197] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:02 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:03.123255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.162394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f470b-21b9-4405-92e8-614451f9e9b5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.206815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.207859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.208149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.208424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.239391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba6de-5be0-4e4f-ad21-bb2d3596d597 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.278461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.279212 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.279941 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.280230 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.281095 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:03.281467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.282949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.291643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 95/198] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:03.292678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.298838 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.300461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.317301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.367286 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.425962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdff4a9-ecb8-46da-918d-dc528c63812c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.451439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 104/199] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:03.452682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.467475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.468833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.469336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.469809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.554833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.556688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.580204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.580398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef4fd-0205-49f1-a0ee-1f8f4d03ab64 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.620708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.622121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.622623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.623091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] PATH_INFO: `/v3/users/8a115be5c68c40c0aa4241ab3614740b` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.624517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] RBAC: Authorizing `identity:get_user(user_id=8a115be5c68c40c0aa4241ab3614740b)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.626283 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.628621 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 105/200] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/users/8a115be5c68c40c0aa4241ab3614740b => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:03.629679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.648580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.688406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 96/201] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:03.689294 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.746744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621bc1b-a9f4-482f-8639-ac0b999934de None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.790581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.791872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.792159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.792716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.794262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.796472 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.798870 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 106/202] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:03.799624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.824868 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faeaf0-ff4f-4c2e-b58c-6fe804a7add2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.847464 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.872974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.874258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.874544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.875079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.888984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:03.910596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df729cb-1ec5-4c66-bd8a-8f34acae80f8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:03.950436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:03.951456 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:03.951735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:03.952003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:03.953188 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.954957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:03.956769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 107/203] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:03.962596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:03.964765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:03.967501 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:04.073437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb96ca-ed93-481d-91a0-5f6e64811d31 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:04.097697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 97/204] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:04.098579 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:04.115305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:04.116042 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:04.116202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:04.116353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:04.116508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:04.117506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=e5b9df23319746d1bca600371549f7b6) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:04.118113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:04.119588 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:04.126733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 108/205] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:03 2022] GET /identity/v3/role_assignments?user.id=e5b9df23319746d1bca600371549f7b6&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:04.127526 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:04.148103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:04.298001 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b668404-942f-4318-b316-64c6d24e934d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:04.336573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78c97-17d8-4619-b98f-a62323dad03d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:04.346015 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:04.346697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:04.346981 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:04.347255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:04.348153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] RBAC: Adding query filter params (role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=e5b9df23319746d1bca600371549f7b6) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:04.348408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:04.350230 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:04.361089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 98/206] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:04 2022] GET /identity/v3/role_assignments?user.id=e5b9df23319746d1bca600371549f7b6&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:04.435202 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:04.436098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:04.436379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:04.436653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:04.442879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:04.444466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bcdeb-89d0-4826-8beb-1dd6429b09d7 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:04.446591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 109/207] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:04 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:04.452311 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:04.596452 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:04.625675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee3b-e7c6-4fb1-9184-058b2f8dc16b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:04.671555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:04.672233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:04.672518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:04.672798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:04.673642 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1, user.id=8a115be5c68c40c0aa4241ab3614740b) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:04.673984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:04.675443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3bf8c-605c-4cd5-b3d9-bbce4d18e2f9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:04.682859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 99/208] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:04 2022] GET /identity/v3/role_assignments?user.id=8a115be5c68c40c0aa4241ab3614740b&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:05.536274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084bb2-fa4b-4dde-86a0-bf4cd4650bcf None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:05.536863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084bb2-fa4b-4dde-86a0-bf4cd4650bcf None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:05.536863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084bb2-fa4b-4dde-86a0-bf4cd4650bcf None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:05.538512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 110/209] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:05.543965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcc1c-2819-43da-83a8-157be38f4565 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:05.544258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcc1c-2819-43da-83a8-157be38f4565 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:05.544540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcc1c-2819-43da-83a8-157be38f4565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:05.562112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-56bfcc1c-2819-43da-83a8-157be38f4565 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:05.563314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-56bfcc1c-2819-43da-83a8-157be38f4565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:05.630332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 100/210] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:05.655166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14084bb2-fa4b-4dde-86a0-bf4cd4650bcf None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:05.750058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:05.771966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14084bb2-fa4b-4dde-86a0-bf4cd4650bcf None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:05.808872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:05.810079 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:05.810561 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:05.811064 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:05.822899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:05.830846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:05.831724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:05.832509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:05.835067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 111/211] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:05.840171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7d7-2e3c-412a-a440-c5f4f5626913 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:05.840171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7d7-2e3c-412a-a440-c5f4f5626913 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:05.840171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7d7-2e3c-412a-a440-c5f4f5626913 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:05.841425 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:05.844714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 101/212] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:05.846363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:05.846655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:05.847071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:05.867146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:05.868365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:05.944573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 102/213] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:05.969100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109b1e-eff6-4906-930e-8f68e12f4630 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:05.970678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:05.975356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.015739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.017221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.017712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.018183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.019563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:06.020050 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.022408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.034544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 112/214] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:06.041242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.044778 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.088588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d69c-17bb-485c-992c-9b3784a62945 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.126648 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.127577 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.127912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.128190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.129462 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.131788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.138013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 103/215] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:06.139560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.175935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967413c-f259-4d2e-b8b0-212533d678f6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.221276 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.222708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.222995 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.223275 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] PATH_INFO: `/v3/users/eac5fdcd2bda42399ddd9b35c13ab134` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.239298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.248552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] RBAC: Authorizing `identity:get_user(user_id=eac5fdcd2bda42399ddd9b35c13ab134)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.251187 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.258260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 113/216] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:06 2022] GET /identity/v3/users/eac5fdcd2bda42399ddd9b35c13ab134 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:06.259664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.282094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df336c6-6646-4eb0-9e45-a2063eff0652 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.327836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.330302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.331495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.332374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.333050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.334144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.335752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.368193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 104/217] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:06 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:06.380461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda13ba9-f457-47ee-ba05-187a65922062 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.421388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.422081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.422367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.422647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.502433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.503844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19d64-f8f2-4f37-990f-6e53e368eec9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.573531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.617417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 114/218] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:06.623125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.694825 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8351-bb67-48e8-b97f-55c54c4390a8 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.695459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8351-bb67-48e8-b97f-55c54c4390a8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8351-bb67-48e8-b97f-55c54c4390a8 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.698551 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 115/219] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:06.704766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.705106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.705396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.728870 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:06.730149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:06.748730 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f268-4bae-4e1b-89f7-573b7c3e4282 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.784287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.795386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.796331 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.796621 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.796904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.798632 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.800878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.804388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 105/220] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:06 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:06.811990 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.837687 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 116/221] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:06.864706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:06.945119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab2635-bbe7-4cc7-90f5-69a302c62006 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:06.979550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:06.980891 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:06.981578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.981889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.982494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.983054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=eac5fdcd2bda42399ddd9b35c13ab134) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:06.983374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:06.984830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27d7c-aec7-49a6-b135-ba7b41341e68 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:06.991458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 106/222] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:06 2022] GET /identity/v3/role_assignments?user.id=eac5fdcd2bda42399ddd9b35c13ab134&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:06.992796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b8fd-232b-4600-978b-2fa123a48355 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:06.993188 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b8fd-232b-4600-978b-2fa123a48355 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:06.993529 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b8fd-232b-4600-978b-2fa123a48355 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:06.994154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85b9d0-6ad3-41de-b6ee-d096aa9ec2eb None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.007384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 107/223] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:07.013736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.013736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.014011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.045326 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.046616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.048105 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:07.048581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.049058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.052860 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:07.074702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:07.088934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:07.089920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:07.090740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:07.103755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 117/224] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:07.109950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.195968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:07.222539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 108/225] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:07.246350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.250578 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4035-fa1e-4855-b608-ead88d346966 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.286839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.287517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.287953 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.288402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.289372 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:07.292446 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:07.292446 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:07.300591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 118/226] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:07.306591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.326561 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:07.427657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f614ca-786e-4bcd-b6a8-3c672db7df36 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.465540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.466601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.466889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.467163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.468400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:07.469877 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:07.471817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 119/227] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:07.477739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.535848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff4fa-153a-42e7-b95e-62888e2413ae None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.569393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:07.598233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67488f57-56a9-4c56-8953-79561ee683fe None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.613675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.614542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.614824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.615142 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.636975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:07.648773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:07.649649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:07.650478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 109/228] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:07.657514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.672289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.673539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.674217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.674780 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.678664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:07.680340 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:07.684617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 120/229] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:07.689242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.723775 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:07.806988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d78a6-3ad0-4098-9d28-e81f744bece2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.844061 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.844805 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df3d16-a6a8-49a5-9d46-e9d68a37d94f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:07.846238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.846523 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.846799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.847562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:07.847870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:07.849928 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:07.869596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 110/230] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:07.876627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:07.894734 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:07.895653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:07.895975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:07.896325 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/users/e5b9df23319746d1bca600371549f7b6/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:07.898544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, user_id=e5b9df23319746d1bca600371549f7b6, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:07.900111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:07.917952 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 121/231] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:07 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/users/e5b9df23319746d1bca600371549f7b6/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:44:08.020788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20eacd-fabd-48f5-af7c-6e37448db7f8 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:08.036479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:08.065658 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:08.066609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:08.066904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:08.067186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:08.068648 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:08.070693 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:08.072813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 111/232] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:07 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:08.078140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:08.102249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:08.231054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d98-5fdd-45f9-825c-205baa23957d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:08.269934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:08.270927 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:08.271250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:08.271527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:08.272907 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:08.274432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde9047-9f07-4f09-b342-d10da0a80b75 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:08.276225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 122/233] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:08 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:08.282450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:08.413701 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e13045-7712-4e25-9ff2-fd64f48bfe94 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:08.448291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:08.449196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:08.449479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:08.449757 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/users/e5b9df23319746d1bca600371549f7b6/roles/0aa203eae9c740c5bffcbdf92d4b5712` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:08.453567 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, user_id=e5b9df23319746d1bca600371549f7b6, role_id=0aa203eae9c740c5bffcbdf92d4b5712)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:08.455066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2682ea-ad13-40e0-befe-165a3a1bd3d9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:08.473816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 112/234] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:08 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/users/e5b9df23319746d1bca600371549f7b6/roles/0aa203eae9c740c5bffcbdf92d4b5712 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:09.097063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c7-63fd-40b6-91d2-751eb7a89678 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.098161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c7-63fd-40b6-91d2-751eb7a89678 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.098651 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c7-63fd-40b6-91d2-751eb7a89678 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.101094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 123/235] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:09.107251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995867a-05fa-4a16-ade3-893f07f47079 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.107712 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995867a-05fa-4a16-ade3-893f07f47079 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.107912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995867a-05fa-4a16-ade3-893f07f47079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.130972 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-a995867a-05fa-4a16-ade3-893f07f47079 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:09.132189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-a995867a-05fa-4a16-ade3-893f07f47079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:09.175521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:09.215508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 113/236] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:09.252792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa86c7-63fd-40b6-91d2-751eb7a89678 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:09.300947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a563-df7d-4ac2-9f13-7f680b0973ad None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.301263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a563-df7d-4ac2-9f13-7f680b0973ad None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.301511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a563-df7d-4ac2-9f13-7f680b0973ad None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.303987 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 114/237] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:09.319595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.319899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.320216 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.379306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:09.379306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:09.381570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:09.433745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa86c7-63fd-40b6-91d2-751eb7a89678 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:09.500298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:09.501466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.501977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.502497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.503937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:09.507302 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:09.511913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 124/238] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:09.517261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:09.535046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 115/239] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 15 21:44:09.604894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:09.665941 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a5d6-5bfd-45e3-af49-253416c4e974 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:09.704850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:09.705965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.706492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.707093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.708019 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:09.711111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286228-ce41-40a0-872e-7be7f99bdea3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:09.735195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:09.751498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 125/240] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:09 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:09.752874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5071a-5cd7-48b6-a681-c423bf8fe56f None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.753156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5071a-5cd7-48b6-a681-c423bf8fe56f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.753423 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5071a-5cd7-48b6-a681-c423bf8fe56f None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.755003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 126/241] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:09.761504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.761775 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.762601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.811067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:09.812312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:09.824191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:09.828480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d36e-f7d0-44f3-8d8a-7b5fe2896d94 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:09.871980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:09.873181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:09.873685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:09.878607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:09.903043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:09.911350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:09.912409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:09.913208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 116/242] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:09.925001 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:09.996793 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 127/243] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:10.019846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.041626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed29aaa-1350-453a-b646-fb384b928d4c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.082748 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.083489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.084039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.084416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.085204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:10.085514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.087031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.098220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 117/244] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:10.104571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.133750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.153896 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14de84-61cb-4c2c-b9aa-e445836f3336 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.202029 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.203138 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.203433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.203841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.206179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.223661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:10.229023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effd7-5a9d-4160-b824-18a9f17b4f67 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:10.237670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:10.238769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:10.239789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 128/245] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:10.247133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.282795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.284324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.284779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.285153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] PATH_INFO: `/v3/users/520449b6ca71421c9c237b0f34baed3a` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.304066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=520449b6ca71421c9c237b0f34baed3a)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.306494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.309077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 118/246] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/users/520449b6ca71421c9c237b0f34baed3a => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:10.317549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.372170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dc326-1a5e-4eee-9d39-8d9d822c1997 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.414224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.441686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d372a4-12cf-402c-ae9d-d999f48a3ef9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.446039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.446731 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.447016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.447292 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.448062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:10.448373 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.449801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.462083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 129/247] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:10.474966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.487263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.487932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.488214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.488489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.549360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.591057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.593079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.614794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68044d-cc36-4886-9501-25e2632d78a0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.659419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.661096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.661621 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.662479 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] PATH_INFO: `/v3/users/eac5fdcd2bda42399ddd9b35c13ab134` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.664072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] RBAC: Authorizing `identity:get_user(user_id=eac5fdcd2bda42399ddd9b35c13ab134)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.666281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.669144 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 130/248] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/users/eac5fdcd2bda42399ddd9b35c13ab134 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:10.675331 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.694490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.720075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 119/249] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:10.725557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.787982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296e24-ba86-40f1-ade6-a3c80194440a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.810674 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.827312 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b9b62-7dc8-4793-8a21-99634328bee7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.828208 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.829496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.830018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.830488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.831892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.833667 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.836222 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 131/250] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:10.842237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.862346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.863226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.863502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.863774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:10.865297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:10.866587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:10.868643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 120/251] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:10.874321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:10.924438 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:10.958454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e2cac-cf5b-43db-99d4-2d27d606c820 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.976872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620655f-5a13-4e70-9854-662f57722ec2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:10.997729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:10.999049 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:10.999473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:10.999884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/users/eac5fdcd2bda42399ddd9b35c13ab134/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.002305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, user_id=eac5fdcd2bda42399ddd9b35c13ab134, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:11.004014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7279ee8-9b12-4de4-ab35-81f0b57f5fcf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:11.014193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:11.014869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.015152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.015423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.016306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=520449b6ca71421c9c237b0f34baed3a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:11.016654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:11.018177 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85b3d-d5c2-423f-8bef-64c0eb1f7613 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:11.023781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 132/252] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:10 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/users/eac5fdcd2bda42399ddd9b35c13ab134/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:44:11.030034 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 121/253] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:10 2022] GET /identity/v3/role_assignments?user.id=520449b6ca71421c9c237b0f34baed3a&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:11.277105 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310027-09ca-4d8f-8171-8f4368d98439 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.278169 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310027-09ca-4d8f-8171-8f4368d98439 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.278670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310027-09ca-4d8f-8171-8f4368d98439 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.281021 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 133/254] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:11.286703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.287212 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.287412 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.310877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:11.312084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:11.424137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 122/255] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:11.468871 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f310027-09ca-4d8f-8171-8f4368d98439 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:11.539834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:11.612848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f310027-09ca-4d8f-8171-8f4368d98439 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:11.654949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:11.655760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.656040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.656314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.667207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-d6852ca7-d7d7-4bff-8f91-f14ab43a2d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:11.675007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:11.675903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:11.676723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 134/256] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:11.682461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:11.764362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:11.794528 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53346c7-94f1-4988-9486-6021687430a8 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.794830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53346c7-94f1-4988-9486-6021687430a8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.795039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53346c7-94f1-4988-9486-6021687430a8 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.797913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 135/257] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:11.802124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.802835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.804054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.823700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fec93-df2b-4936-8c92-1aab1330cac6 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:11.842901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:11.844120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:11.857832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:11.858543 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:11.858825 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:11.859120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:11.859848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:11.860156 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:11.861658 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:11.871093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 123/258] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:11.876707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:11.961381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 136/259] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:11.976973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f0cb-6795-4e0d-be17-fc1b076eaffa None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:11.979604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.003320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.018258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.018258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.018258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.018258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.018628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.019435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.021073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 124/260] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:11 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:12.032905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.081221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.206429 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090d10-6856-477e-a6d1-477ec3d03f04 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.216068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3721b80-3a81-428d-8f4d-37907f951528 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.242246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.242916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.243584 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.243869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.295822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.320691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.322332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.342786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.343641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.343936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.344215 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.382348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:12.402277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:12.403219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:12.403997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:12.406681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 137/261] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:12.412310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.461776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 125/262] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:12.475685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.565518 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.570463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11d09-ffc4-4231-9008-9a569205bcbe None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.608135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.609083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.609534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.610012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.611308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:12.611806 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.613353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.623364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 138/263] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:12.631470 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.669836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.712171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1a72e-fe4b-490f-b9c5-c37fcb3c314d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.771717 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.772897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.773189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.773471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.778725 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.780683 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.785882 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 126/264] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:12.790000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.796560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695d48-6a60-4958-a00b-944fb924547b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.866749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.867971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.868464 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.868925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] PATH_INFO: `/v3/users/e5b9df23319746d1bca600371549f7b6` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.870526 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b9df23319746d1bca600371549f7b6)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.872284 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.874569 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 139/265] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/users/e5b9df23319746d1bca600371549f7b6 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:12.880005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:12.935209 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d65faa-b60c-4571-9df9-73b268125c10 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:12.939101 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:12.975319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:12.976243 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:12.978165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:12.978165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:12.978165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=e5b9df23319746d1bca600371549f7b6) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:12.978165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:12.980003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:12.987550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 127/266] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/role_assignments?user.id=e5b9df23319746d1bca600371549f7b6&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:13.064829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffa63f-4868-4e1d-a435-21624f8963e0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:13.104921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:13.105856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.106294 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.106703 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.190070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:13.191800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:13.227343 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:13.316509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 140/267] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:13.322973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:13.329788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:13.475778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a34f2-1af6-44fc-b52e-3c71f4656ad4 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:13.522719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:13.523616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.523897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.524172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.525431 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:13.526915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f3809-ba44-47d8-8635-ddb45d9d2d7f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:13.528959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 128/268] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:13 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:13.535226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:13.581778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb351-2f56-4bf1-9800-8809a1f1db5b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.582135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb351-2f56-4bf1-9800-8809a1f1db5b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.582368 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb351-2f56-4bf1-9800-8809a1f1db5b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.583947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 129/269] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:13.597894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.597894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.597894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.624675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:13.627631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:13.719853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c51a-f124-489c-9374-bcac6331e7c0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:13.759775 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 130/270] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:13.770832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:13.780837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:13.781499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.781783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.782083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.782982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] RBAC: Adding query filter params (role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=e5b9df23319746d1bca600371549f7b6) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:13.783300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:13.784764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:13.789091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:13.791387 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:13.798599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 141/271] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:13 2022] GET /identity/v3/role_assignments?user.id=e5b9df23319746d1bca600371549f7b6&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:13.903520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25baa5-276b-4f32-b729-850eedfec372 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:13.942852 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:13.943742 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:13.944025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:13.944393 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:13.956026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-5901804d-0ccc-4016-abf1-96c146b27dd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:13.964206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:13.965146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:13.965950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 131/272] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:13.971587 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.000011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca253-9160-45d2-a418-67d0f5c2b8db None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.000369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca253-9160-45d2-a418-67d0f5c2b8db None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.000575 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca253-9160-45d2-a418-67d0f5c2b8db None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.002263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 132/273] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:14.008957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.009249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.009529 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.030121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:14.031263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:14.103598 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:14.113474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 133/274] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:14.140828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.191603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8ffb9-d494-4337-a9df-2d67a4a94c9b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.231923 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.232604 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.232889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.233160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.235135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:14.235456 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:14.236857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:14.246855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 142/275] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:14.253050 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.272244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da213fa-adf2-4ec6-a56b-d506c9b59ad4 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.317937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:14.320287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.321149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.321391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.321761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.323685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:14.325367 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:14.327402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 134/276] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:14.333031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.375904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adf8ab-6622-4c25-804a-e4fdac8be9db None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.403890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:14.420560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.421553 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.421849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.422141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] PATH_INFO: `/v3/users/4526f2a6211b40539db887e1981e8cd3` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.441527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] RBAC: Authorizing `identity:get_user(user_id=4526f2a6211b40539db887e1981e8cd3)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:14.443299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63ae1-9905-4460-8406-4cc51d29a33f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:14.449890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 143/277] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/users/4526f2a6211b40539db887e1981e8cd3 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:14.449890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6b34-22a2-48b7-8587-e735db93851f None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.449890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6b34-22a2-48b7-8587-e735db93851f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.449890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6b34-22a2-48b7-8587-e735db93851f None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.449890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 144/278] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:14.454174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6b34-22a2-48b7-8587-e735db93851f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.454360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4905766-34ed-459a-a0a5-3ae1ad1121af None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.496171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.496994 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.497342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.497684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.498521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:14.500086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d02c9-6440-408a-bdcf-56fe6a870170 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:14.529922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 135/279] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:14 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:44:14.529922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.529922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.529922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.548274 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:14.549616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:14.611968 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6b34-22a2-48b7-8587-e735db93851f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.629407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 136/280] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:14.634312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:14.657491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.665517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.666237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.666517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.666790 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.667642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, user.id=4526f2a6211b40539db887e1981e8cd3, scope.system=all) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:14.667959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:14.669566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977bff6-5013-4607-9359-20a6dd2f492a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:14.675763 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 145/281] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/role_assignments?user.id=4526f2a6211b40539db887e1981e8cd3&scope.system=all&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:14.677188 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee6e51-e4d3-4957-b666-39a4998c37a1 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.677569 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee6e51-e4d3-4957-b666-39a4998c37a1 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.677848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee6e51-e4d3-4957-b666-39a4998c37a1 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.679573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 146/282] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:14.685664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.685986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.686267 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.706305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:14.707906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:14.725890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:14.803226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 147/283] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:14.811864 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ada9-924d-4c81-a7f1-94aa0d364a7c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.827431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.857932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:14.858751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:14.859037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:14.859313 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:14.876687 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:14.886550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:14.887467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:14.888255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 137/284] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:14.894907 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:14.961996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d799a-9ef9-4a86-a426-7860d7a26fe9 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:14.971727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.006020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.006834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.007117 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.007387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.019130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:15.020436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1dfc8-6b4d-4b0e-afb4-f2a8dab85603 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:15.027261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:15.028172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:15.028996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:15.030917 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.031005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 148/285] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:15.039444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.063771 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.064456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.064740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.065013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.065770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:15.066109 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.067587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.081504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 138/286] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:15.082775 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.166328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65647fc-e4e3-4b3d-a8ca-24ac99143fa6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.205853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.206798 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.207085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.207369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.208139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:15.208450 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.210030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.232485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 149/287] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:15.239987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.277610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.285721 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d62f3-5caf-4e28-94ff-e6a24a8b2fcd None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.326793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.327707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.327994 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.328271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] PATH_INFO: `/v3/users/eac5fdcd2bda42399ddd9b35c13ab134` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.336537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] RBAC: Authorizing `identity:get_user(user_id=eac5fdcd2bda42399ddd9b35c13ab134)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.336537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.336537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 139/288] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/users/eac5fdcd2bda42399ddd9b35c13ab134 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:15.340275 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.410614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.419200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86d414-5a59-40e0-8da2-5719ed24c7e4 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.464067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.464956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.465243 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.465523 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] PATH_INFO: `/v3/users/520449b6ca71421c9c237b0f34baed3a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.467469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] RBAC: Authorizing `identity:get_user(user_id=520449b6ca71421c9c237b0f34baed3a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.468931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.471645 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 150/289] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/users/520449b6ca71421c9c237b0f34baed3a => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:15.480783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.547092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4e66e-f06b-4907-b41d-bdc8b594a460 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.614285 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.618424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd2458-6a43-4834-bf83-efc3d2dd241e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.655467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.656344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.656628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.656904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.658566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.660017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.661749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 151/290] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:15.668314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.668998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.669341 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.669564 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.671414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.750643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.752397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.816098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:15.877569 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00d86-1f79-4d3c-ae0c-800feab5ac53 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:15.931978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 140/291] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:15.935768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:15.945852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:15.946776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:15.947060 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:15.947339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/users/520449b6ca71421c9c237b0f34baed3a/roles/88a609cbdd6a4ca1b41b2eccd795e57c` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:15.954674 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, user_id=520449b6ca71421c9c237b0f34baed3a, role_id=88a609cbdd6a4ca1b41b2eccd795e57c)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:15.956131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:15.980693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 152/292] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:15 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/users/520449b6ca71421c9c237b0f34baed3a/roles/88a609cbdd6a4ca1b41b2eccd795e57c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:16.065442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1874-6409-4a97-bdf3-ef45625c4169 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:16.113654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:16.114906 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:16.115398 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:16.115812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:16.117343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:16.119066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46292b6-dd48-4cd5-859e-547d435bb92a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:16.121473 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 141/293] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:15 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:16.127473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:16.173336 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:16.289501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7826-76e5-4627-94ba-6da2fd62a0d0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:16.324558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:16.325222 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:16.325510 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:16.325795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:16.326753 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=eac5fdcd2bda42399ddd9b35c13ab134) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:16.327070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:16.328548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcd15-6963-41ba-b1e4-c2aa41ee3a41 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:16.334783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 153/294] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:16 2022] GET /identity/v3/role_assignments?user.id=eac5fdcd2bda42399ddd9b35c13ab134&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:17.241749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45462-857b-49c5-bede-90e58642e82d None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.242379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45462-857b-49c5-bede-90e58642e82d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.242379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45462-857b-49c5-bede-90e58642e82d None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.243763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 142/295] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:17.249685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.250244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.250475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.268779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:17.270039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:17.270631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1723bd-bbd4-4fa9-8c8f-47963f072650 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.271312 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1723bd-bbd4-4fa9-8c8f-47963f072650 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.271947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1723bd-bbd4-4fa9-8c8f-47963f072650 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.273893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 143/296] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:17.279314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782220f5-b103-4234-a4c3-1286fd052ad3 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.280187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782220f5-b103-4234-a4c3-1286fd052ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.280658 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782220f5-b103-4234-a4c3-1286fd052ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.289414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.305538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-782220f5-b103-4234-a4c3-1286fd052ad3 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:17.307094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-782220f5-b103-4234-a4c3-1286fd052ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:17.357960 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 154/297] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:17.384735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.385830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 144/298] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:17.387374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b4e5-be9f-4dca-ac84-3a6fd2cf111b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.387669 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b4e5-be9f-4dca-ac84-3a6fd2cf111b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.387952 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b4e5-be9f-4dca-ac84-3a6fd2cf111b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.389324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 145/299] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:17.397782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.398097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.398697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.412819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.418658 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:17.419847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:17.490411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 146/300] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:17.491367 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.501987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770695-2113-4ba2-8586-2d6da8923826 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.547363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.549171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.549962 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.550437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.555355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.565904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:17.573443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:17.574874 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 155/301] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:17.576136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.604909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d57a61-58cd-4156-8b40-08df262907fd None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.640871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.641773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.642103 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.642382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.643559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:17.645032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:17.647413 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 147/302] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:17.648193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.669305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.692401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476212-6232-4748-b875-7389288e68f0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.730327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.731118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.731368 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.731659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.742610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:17.750232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:17.751107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:17.751899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 156/303] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:17.752919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.765333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0fe6-9ccc-419c-a4ed-ec1f74b76724 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.796432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.802680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.803617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.803906 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.804181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.804939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:17.805246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:17.806678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:17.815442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 148/304] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:17.816244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.866033 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12d7b-ae9a-42f3-a235-460199d1a8ce None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.905364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.906068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.906352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.906627 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] PATH_INFO: `/v3/groups` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.907352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:17.908831 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:17.922054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:17.945905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 157/305] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Jul 15 21:44:17 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:17.945905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:17.950900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03c92-1a33-42e6-8625-172d25912150 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:17.992702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:17.993567 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:17.993949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:17.994338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:17.995322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:17.995735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:17.997414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:18.009234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 149/306] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:18.015180 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:18.070297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af0189-df13-4a0c-a4df-63bda3f54465 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:18.098709 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:18.108030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:18.108918 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.109198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.109473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] PATH_INFO: `/v3/users/4526f2a6211b40539db887e1981e8cd3` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.110749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] RBAC: Authorizing `identity:get_user(user_id=4526f2a6211b40539db887e1981e8cd3)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:18.112393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:18.114118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 158/307] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:17 2022] GET /identity/v3/users/4526f2a6211b40539db887e1981e8cd3 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:18.120213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:18.161510 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ee49-7ee4-4d46-bd34-bab08982ee2d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:18.200201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:18.216363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:18.218168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.218168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.218328 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] PATH_INFO: `/v3/users/1956ed4fea3d4c2c915aef98c913ccbe` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.244859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbff8a-4e88-4dd3-aeb2-e3b430e79d4b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:18.249655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] RBAC: Authorizing `identity:get_user(user_id=1956ed4fea3d4c2c915aef98c913ccbe)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:18.251761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:18.255185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 150/308] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:18 2022] GET /identity/v3/users/1956ed4fea3d4c2c915aef98c913ccbe => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:18.260650 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:18.281919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:18.282802 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.283082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.283356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] PATH_INFO: `/v3/system/users/4526f2a6211b40539db887e1981e8cd3/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.284947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4526f2a6211b40539db887e1981e8cd3, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:18.286492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b6c68-d145-4ae4-a89d-1eecc851e9df None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:18.306894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 159/309] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Jul 15 21:44:18 2022] PUT /identity/v3/system/users/4526f2a6211b40539db887e1981e8cd3/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:44:18.406057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5a5c-38c1-4aef-b5a0-d5883f2a5135 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:18.430468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:18.455211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:18.456096 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.456448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.456862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.457838 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, user.id=1956ed4fea3d4c2c915aef98c913ccbe, scope.system=all) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:18.458287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:18.461018 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2e445-c635-4941-a134-069b08e2f416 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:18.467927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 151/310] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Jul 15 21:44:18 2022] GET /identity/v3/role_assignments?user.id=1956ed4fea3d4c2c915aef98c913ccbe&scope.system=all&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:18.609837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236484-d020-4e2d-a1e1-7b2eba128421 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.610271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236484-d020-4e2d-a1e1-7b2eba128421 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.610652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236484-d020-4e2d-a1e1-7b2eba128421 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.612581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 160/311] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:18.618679 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.618986 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.619229 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.637592 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:18.638857 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:18.711146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 152/312] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:18.735094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236484-d020-4e2d-a1e1-7b2eba128421 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:18.838505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236484-d020-4e2d-a1e1-7b2eba128421 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:18.872159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:18.878545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:18.879867 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:18.880508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:18.880830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:18.892249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:18.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:18.901096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:18.901894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 161/313] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:18.907858 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:19.009551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eea46-0fe7-4d3f-b0cb-f96714d16c87 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:19.018977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:19.044986 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:19.045673 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:19.045983 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:19.046257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:19.047008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:19.047310 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:19.048676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:19.058682 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 153/314] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:19.064104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:19.168961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e857-e5a1-4093-bb37-a81c0b745f69 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:19.203595 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:19.204717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:19.205161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:19.205567 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] PATH_INFO: `/v3/users/520449b6ca71421c9c237b0f34baed3a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:19.207014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] RBAC: Authorizing `identity:get_user(user_id=520449b6ca71421c9c237b0f34baed3a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:19.208853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:19.211112 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 162/315] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:19 2022] GET /identity/v3/users/520449b6ca71421c9c237b0f34baed3a => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:19.216822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:19.321706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696c588-e6bc-4f51-a390-a531bb0e87b8 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:19.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:19.357107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:19.357381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:19.357652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:19.438039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:19.439420 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:19.442154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:19.539239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 154/316] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:19.545268 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:19.607427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:19.654256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc23e4-70ba-4ef4-9e3f-3bc0d8c589bc None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:19.694349 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:19.695138 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:19.695415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:19.695682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:19.696871 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:19.698418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2c446-6a9e-43e9-9fe5-aeb30d16dbad None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:19.700450 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 163/317] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:19 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:19.706992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:19.783842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:19.815100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2e0e0-bae4-4e15-8345-511398729364 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:19.849077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:19.849771 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:19.850093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:19.850364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:19.851187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, scope.project.id=670ea56837f642849cf27aa0b764fb27, user.id=520449b6ca71421c9c237b0f34baed3a) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:19.851496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:19.852932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968ef6-f92b-4e30-a454-0483c1ea2cc8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:19.859200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 155/318] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:19 2022] GET /identity/v3/role_assignments?user.id=520449b6ca71421c9c237b0f34baed3a&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:20.437333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696fce3-39d8-4bb6-9368-40af3d4546e5 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.437563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696fce3-39d8-4bb6-9368-40af3d4546e5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.437891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696fce3-39d8-4bb6-9368-40af3d4546e5 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.439474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 164/319] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:20.444657 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.445143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.445227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.463604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:20.464832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:20.537050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 156/320] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:20.560131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696fce3-39d8-4bb6-9368-40af3d4546e5 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:20.670800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696fce3-39d8-4bb6-9368-40af3d4546e5 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:20.701217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:20.712079 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:20.712886 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.713136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.713436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.714626 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:20.716077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705f58e-cbd3-4515-8d5d-2d254d0a5877 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:20.717957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 165/321] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:20.723418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:20.750648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe91-2799-4652-9859-c10c2fac1aa5 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.750997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe91-2799-4652-9859-c10c2fac1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.751211 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe91-2799-4652-9859-c10c2fac1aa5 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.752609 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 166/322] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:20.757596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc282-fae6-4457-9c14-f0059e12fc8f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.757904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc282-fae6-4457-9c14-f0059e12fc8f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.758195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc282-fae6-4457-9c14-f0059e12fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.776091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-8bdcc282-fae6-4457-9c14-f0059e12fc8f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:20.777269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-8bdcc282-fae6-4457-9c14-f0059e12fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:20.791639 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:20.832032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584dd6d-5095-4a41-9f21-524b49f4fc73 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:20.852505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 167/323] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:20.854289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6e8c-e93d-4ea1-9b2c-20a81a2ad2bb None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.854587 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6e8c-e93d-4ea1-9b2c-20a81a2ad2bb None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.854867 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6e8c-e93d-4ea1-9b2c-20a81a2ad2bb None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.856265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 168/324] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:20.861590 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.861908 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.862204 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.867934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:20.868496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:20.868782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:20.869063 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] PATH_INFO: `/v3/groups` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:20.870043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:20.871224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:20.883249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:20.884458 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:20.889911 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 157/325] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Jul 15 21:44:20 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:20.889911 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:20.971354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 169/326] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:20.997081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.008425 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030fef4-a548-46a4-960a-a94e32148831 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.036986 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.050417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.051244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.051576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.051856 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.061262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.064286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:21.073448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:21.074627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:21.075557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 158/327] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:21.080678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.119023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee759af6-a0fa-48ea-b7d0-840b2a9b7b7b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.161578 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.162579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.162867 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.163143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.175117 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:21.185096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:21.186056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:21.186855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 170/328] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:21.193611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.207540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a417a-e62e-497b-ba35-46e64245b628 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.262736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.263356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.263647 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.263930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.264699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:21.265012 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.267020 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.278138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 159/329] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:21.284126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.336740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635345-4ede-4076-be01-0c9af28eb7af None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.342321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.358660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.385224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.385962 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.386224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.386501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.389065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:21.389388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.392239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.407238 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 171/330] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:21.413159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.435780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3347bd-8111-41a4-a3c1-d9c79f59777a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.475895 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.476892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.477252 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.477955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] PATH_INFO: `/v3/users/4526f2a6211b40539db887e1981e8cd3` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.479132 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] RBAC: Authorizing `identity:get_user(user_id=4526f2a6211b40539db887e1981e8cd3)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.480866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.486093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 160/331] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:21 2022] GET /identity/v3/users/4526f2a6211b40539db887e1981e8cd3 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:21.489339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.541275 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67cbe-2538-4bf0-836f-66f913298f7e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.582037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.583289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.583714 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.584066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] PATH_INFO: `/v3/users/1956ed4fea3d4c2c915aef98c913ccbe` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.586539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] RBAC: Authorizing `identity:get_user(user_id=1956ed4fea3d4c2c915aef98c913ccbe)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.588077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.593956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 172/332] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:21 2022] GET /identity/v3/users/1956ed4fea3d4c2c915aef98c913ccbe => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:21.596877 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:21.625532 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111d9e3-9e48-49fe-b8da-1b740802400c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.642999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.660368 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:21.684530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.686742 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.688153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.688653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.689810 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] RBAC: Adding query filter params (role.id=54adb043b23b4378ad3430fdd81e36bd, user.id=4526f2a6211b40539db887e1981e8cd3, scope.system=all) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:21.691830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.695291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c8b64-ced3-4107-a925-d9e7d41c02ee None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.714322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 161/333] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Jul 15 21:44:21 2022] GET /identity/v3/role_assignments?user.id=4526f2a6211b40539db887e1981e8cd3&scope.system=all&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:21.742171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26e43-b812-4468-90c3-cabfd23c11a6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:21.782454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:21.783336 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:21.783617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:21.783896 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] PATH_INFO: `/v3/system/users/1956ed4fea3d4c2c915aef98c913ccbe/roles/88a609cbdd6a4ca1b41b2eccd795e57c` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:21.785407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1956ed4fea3d4c2c915aef98c913ccbe, role_id=88a609cbdd6a4ca1b41b2eccd795e57c)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:21.787153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a9ad5-2689-49df-b387-a082741499a3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:21.799903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 173/334] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Jul 15 21:44:21 2022] PUT /identity/v3/system/users/1956ed4fea3d4c2c915aef98c913ccbe/roles/88a609cbdd6a4ca1b41b2eccd795e57c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:44:23.556234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d181b9-1265-416e-a1f5-0b6adbb111ea None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:23.557283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d181b9-1265-416e-a1f5-0b6adbb111ea None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:23.557798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d181b9-1265-416e-a1f5-0b6adbb111ea None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:23.559441 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 162/335] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:23.565024 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:23.565934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:23.566409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:23.591124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:23.592691 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:23.679034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 174/336] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:23.712973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d181b9-1265-416e-a1f5-0b6adbb111ea None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:23.848317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d181b9-1265-416e-a1f5-0b6adbb111ea None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:23.890758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:23.891978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:23.892459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:23.892937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:23.907604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-0e234658-de6b-469e-9ae7-5dc503f324d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:23.916320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:23.917211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:23.918023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:23.920415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 163/337] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:23.926693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:23.972969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.042758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb178-e31a-4000-895d-0da4807de202 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.043105 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb178-e31a-4000-895d-0da4807de202 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.043325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb178-e31a-4000-895d-0da4807de202 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.044875 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 164/338] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:24.047519 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf929e-0596-4f2c-8a5d-064db9badf97 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.052442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.052979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.053463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.076219 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:24.078024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:24.086196 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.094596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.094930 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.095216 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.096000 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:24.096312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:24.097899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:24.113482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 175/339] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:24.121209 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.121378 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.168456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 165/340] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:24.207714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.279085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.288610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155764-e7a2-4c38-b897-a3d358701faf None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.332909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.333645 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.333969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.334232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.412768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d8be-f698-4b49-a47a-6ff06b10cc0f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.461890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:24.461890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:24.475760 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.476857 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.477282 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.477698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.496491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:24.509158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:24.510332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:24.511268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:24.513532 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 166/341] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:24.524979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.564252 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.614172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.622160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 176/342] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:24.623091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.694031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023899-f839-42e7-b2e4-acdb597d0e07 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.745485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.746505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.746989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.747404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.748311 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:24.748767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:24.750533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:24.763820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52268f-12aa-433e-9486-4335bef05755 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.766318 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 167/343] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:24.772006 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.827876 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.828705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.828984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.829256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:24.830556 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:24.832054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:24.837888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 177/344] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:24.840747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:24.914057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.935051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb107-b636-487a-8c24-ea803061538f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.959467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:24.998623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:24.999298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:24.999547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5f57d-f29d-4421-a8a3-dc3eeaf9c449 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:24.999659 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:24.999849 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.058153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:25.059313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.059969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.061309 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.079528 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:25.081106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ef7b-e366-44ea-bf95-fcef9b40fe56 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:25.083324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 178/345] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:25.088330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6071-0061-49b4-948a-535ac8c6cf10 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.088330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6071-0061-49b4-948a-535ac8c6cf10 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.088330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6071-0061-49b4-948a-535ac8c6cf10 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.088330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 179/346] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:25.095162 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c6071-0061-49b4-948a-535ac8c6cf10 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:25.097052 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:25.099030 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a133c-b578-49cb-b9b6-b11302cc50b2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:25.237767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:25.268635 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 168/347] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:25.274346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.274674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.274927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.293301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c6071-0061-49b4-948a-535ac8c6cf10 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:25.306961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:25.308186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:25.335754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:25.346858 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:25.347538 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.347823 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.348098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.348950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:25.353706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:25.355297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:25.367254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 180/348] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:25.368106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:25.457007 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 169/349] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:25.485461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:25.636810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6e2f-afe9-4da7-9d66-8ab5c99e2261 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:25.670542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e931c7f-40c6-4841-a5ce-684d9c374140 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:25.686188 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:25.716135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:25.717044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.717434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.717818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.720593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:25.721192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:25.722071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.722179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf6fa-7515-4b2c-b2fe-c62eeb1ad920 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:25.722360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.722640 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.724220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 181/350] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:25.726305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcfca-de6e-4100-9fbd-1dd51de26740 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.726581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcfca-de6e-4100-9fbd-1dd51de26740 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.726865 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcfca-de6e-4100-9fbd-1dd51de26740 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.729956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 182/351] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:25.730805 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcfca-de6e-4100-9fbd-1dd51de26740 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:25.739612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-c10da63e-945a-480e-be46-05eb42a0bea4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:25.747971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:25.748899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:25.749740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 170/352] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:25.750968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.753359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.753359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.771048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:25.772943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:25.822264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:25.866467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 171/353] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:25.867540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:25.888530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcfca-de6e-4100-9fbd-1dd51de26740 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:25.955520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:25.956400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:25.956683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:25.958186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:25.960940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:25.962676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:25.964516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 183/354] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:25.968560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.067142 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017440b-1704-475d-b4ad-8a95a8225411 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.071609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.118835 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.119804 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.120093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.120375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.121308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:26.121977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:26.123664 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:26.131893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba29297-656d-45d2-b075-de832223ef52 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.136891 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 172/355] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:26.137782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.170994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.179919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.180737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.181020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.181294 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.197975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-79489179-2d52-4c67-8eaf-1a16ee3f9c5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:26.206746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:26.207679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:26.208488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 184/356] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:26.209626 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01698-246b-41a6-a917-3c5eea9d65d9 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.213889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01698-246b-41a6-a917-3c5eea9d65d9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.213889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01698-246b-41a6-a917-3c5eea9d65d9 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.213889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 185/357] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:26.213889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01698-246b-41a6-a917-3c5eea9d65d9 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.284226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac15ef-8872-4179-889c-1f406884685c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.333889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.334806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.335251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.335655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.336630 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:26.336947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:26.341040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e82b5-c9ed-40dc-a24e-2aceb57883ca None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:26.341163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01698-246b-41a6-a917-3c5eea9d65d9 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.344189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 173/358] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:26.345715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ff46-218b-4657-90ac-f3d5de2ca8fb None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.345827 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ff46-218b-4657-90ac-f3d5de2ca8fb None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.346117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ff46-218b-4657-90ac-f3d5de2ca8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.367406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-8fd6ff46-218b-4657-90ac-f3d5de2ca8fb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:26.369019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-8fd6ff46-218b-4657-90ac-f3d5de2ca8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:26.410006 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.416402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.417312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.417597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.417884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] PATH_INFO: `/v3/users/1956ed4fea3d4c2c915aef98c913ccbe` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.419139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] RBAC: Authorizing `identity:get_user(user_id=1956ed4fea3d4c2c915aef98c913ccbe)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:26.420615 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:26.422845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 186/359] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/users/1956ed4fea3d4c2c915aef98c913ccbe => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:26.423655 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.482971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 174/360] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:26.484189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ad1-2e4d-4cce-bb4d-13ffc7c8b7af None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.484479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ad1-2e4d-4cce-bb4d-13ffc7c8b7af None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.484754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ad1-2e4d-4cce-bb4d-13ffc7c8b7af None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.490625 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 175/361] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:26.491571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538ad1-2e4d-4cce-bb4d-13ffc7c8b7af None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.495440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.550711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7617-1566-46da-86f4-912a643dab70 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.601835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.602576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.602887 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.603129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.603897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:26.604206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:26.605588 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d306-b618-4d21-b442-2926ac8b8627 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:26.614921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 187/362] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:26.616302 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.616593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.616872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.635442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:26.636730 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:26.648359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538ad1-2e4d-4cce-bb4d-13ffc7c8b7af None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.695975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.697793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.698510 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.698975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.700118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] RBAC: Adding query filter params (role.id=88a609cbdd6a4ca1b41b2eccd795e57c, user.id=1956ed4fea3d4c2c915aef98c913ccbe, scope.system=all) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:26.700582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:26.702570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:26.718934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 176/363] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/role_assignments?user.id=1956ed4fea3d4c2c915aef98c913ccbe&scope.system=all&role.id=88a609cbdd6a4ca1b41b2eccd795e57c => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:26.720062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.727006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 188/364] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:26.728502 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:26.769209 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.827404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:26.897903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020b8d4-e96d-43ed-ab13-683c79274b6b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.904145 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c586e25-aed8-450c-8ce8-274ef5165208 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:26.937313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.938029 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.938416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.938701 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.971763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:26.972886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:26.973354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:26.973845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:26.991531 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:27.001076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:27.002408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:27.003220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:27.006949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 177/365] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:27.008240 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.024949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.027447 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.089839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.111765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.140778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ecd08-c5cc-40ac-a39c-2c658eadaef2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.145784 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 189/366] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:27.147337 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.188107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.189198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.189487 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.189769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.206960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:27.218283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:27.219197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:27.220023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 178/367] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:27.220671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.292429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4e12d-f87f-4434-befc-2b8c8ed0bd21 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.343536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.344256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.344539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.344820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.345586 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:27.345918 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.347323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.354623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72956bbe-5842-4684-a6a3-fbc3915fb1dc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.356289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 190/368] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:27.357206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.374771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.406210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.407121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.407403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.407671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.409558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.411048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.416339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 179/369] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:27.416339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.424715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.517506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c97d4-1aa8-4632-abe6-eaf27103978b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.541277 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf4b7-a6e9-49e6-ac37-b8f000251caa None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.561825 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.562460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.562741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.563015 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.563986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:27.564094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.565457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.575159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 191/370] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:27.575992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.579722 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.580696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.581244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.581711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.653979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.656178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.660365 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.665997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.688508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66969a-b4a1-4f05-9c1e-5e4b8c21a11c None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.728880 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.729754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.730063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.730339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.731671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.733122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.734786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 192/371] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:27.739330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.807563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 180/372] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:27.809163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.861614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75afe-af7f-49cf-8501-9629b63973cd None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.899888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.900555 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.900842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.901444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.922252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.925912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8ea9-f3a3-4b27-a581-54eea062dbd5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:27.934477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:27.965544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:27.966254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:27.966540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:27.966818 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:27.967667 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=670ea56837f642849cf27aa0b764fb27) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:27.967981 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.969454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:27.975854 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 181/373] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:27.976690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:27.979125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:27.980620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.091621 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed618cb-8758-4aa9-9783-edb078149d67 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.102280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 193/374] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:28.103249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.131802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.132618 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.132898 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.133175 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.134505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.136138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.137978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 182/375] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:27 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.143967 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.178281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:28.206590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:28.266402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d018-f821-49a7-a397-3c82dce64c87 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.289435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff1fa-c562-49c2-ad12-e3d7f422814e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.330146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.330516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.331102 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.331434 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.331715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.332274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.332747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.332937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.333413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] PATH_INFO: `/v3/projects/f982803038e141998f61945f94c1d197` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.334477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.334980 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] RBAC: Authorizing `identity:get_project(project_id=f982803038e141998f61945f94c1d197)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.336474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 183/376] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.336599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.338412 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 194/377] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/projects/f982803038e141998f61945f94c1d197 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.343982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.345315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.501116 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9ecb-3e83-41e8-984b-8ae83abc2135 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.525434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:28.554578 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.555712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.556139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.556573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] PATH_INFO: `/v3/groups/b266ace7fef242bc983c44adc9be055a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.563605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] RBAC: Authorizing `identity:get_group(group_id=b266ace7fef242bc983c44adc9be055a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.565275 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e15-a26e-4fc0-ac9b-0c58bd7c9887 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.568419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 195/378] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/groups/b266ace7fef242bc983c44adc9be055a => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.570623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcce3d-c8bb-4355-9a55-7a5a7ab21e5d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.571063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcce3d-c8bb-4355-9a55-7a5a7ab21e5d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.571770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcce3d-c8bb-4355-9a55-7a5a7ab21e5d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.578325 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 196/379] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:28.579941 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.580374 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.580820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.585271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44ba9-db64-4a62-87dc-75f124de24d7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.595149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:28.606527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:28.608331 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:28.631643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.632576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.633032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.633454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.634504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=670ea56837f642849cf27aa0b764fb27) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:28.635482 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.637349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.646564 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 184/380] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.647962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.697345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 197/381] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:28.722135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:28.820824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87060ee-d940-4985-ba78-f2b2a0e2816f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.892458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.893127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.893407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.893735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.894624 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] RBAC: Adding query filter params (group.id=b266ace7fef242bc983c44adc9be055a, role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=f982803038e141998f61945f94c1d197) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:28.894967 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:28.896542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:28.904971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 185/382] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/role_assignments?group.id=b266ace7fef242bc983c44adc9be055a&scope.project.id=f982803038e141998f61945f94c1d197&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:28.913738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03525ccc-c14a-4962-9367-09473e3d0723 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:28.927143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:28.964483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:28.965299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:28.965580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:28.965854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:28.978372 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:28.986359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:28.987306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:28.988089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 198/383] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:28.998354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:29.044280 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:29.125486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec554c-ffd3-4791-b478-021e6bf3150f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:29.169751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:29.170514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.170802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.171082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.171882 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:29.172196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:29.173645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:29.184197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 186/384] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:29.191233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:29.330323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f537-8dd3-4613-b2b9-bb9a959e9715 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:29.374488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:29.375364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.375640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.375915 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.377098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:29.378579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74521d65-7e11-42e9-8597-8b75d955f244 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:29.380785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 199/385] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:29 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:29.386179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:29.485958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade3c7-f11d-4ab9-a351-fa41dc5096e6 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.486263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade3c7-f11d-4ab9-a351-fa41dc5096e6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.486442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade3c7-f11d-4ab9-a351-fa41dc5096e6 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.488404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 200/386] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:29.494641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.494922 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.495152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:29.495254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.503016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538922-3598-4fe2-8d68-70bc5794f81c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:29.520884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:29.522171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:29.575772 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:29.576662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.576946 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.577223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.579470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:29.579891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:29.580929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:29.582865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 187/387] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:29 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:29.589357 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:29.663701 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 201/388] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:29.723622 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:29.760520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddac19-2b6e-48de-9e06-1625a9b5c756 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:29.801941 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:29.803354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.803836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.804324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/groups/393c6c8467b248d6858d7eeaa12e147e/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.807924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, group_id=393c6c8467b248d6858d7eeaa12e147e, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:29.809797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:29.839832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 188/389] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Jul 15 21:44:29 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/groups/393c6c8467b248d6858d7eeaa12e147e/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:29.906757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292271e-7262-4a81-88d8-8e70d5989ce8 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:29.948094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:29.949827 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:29.950355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:29.950836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:29.964369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:29.973155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:29.974253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:29.975317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:29.982119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 202/390] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:29.984401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:30.017998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:30.111484 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463640a1-9211-4749-9719-68fde91e3c4e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:30.163093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:30.164085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:30.164515 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:30.164935 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:30.165836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:30.166311 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:30.167853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:30.181013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 189/391] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:30.186708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:30.220233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:30.318020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fd3f-85d0-40e6-b2ce-e594ecb53f1a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:30.366614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:30.367805 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:30.368304 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:30.368718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:30.370076 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:30.371669 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:30.373759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 203/392] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:30 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:30.379652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:30.480877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:30.500749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0575-f5ef-4bc4-83b3-c9ead058fbad None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:30.542158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:30.543068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:30.543355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:30.543633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:30.549552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:30.551074 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8de507-ebf6-4173-9292-75e28271f073 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:30.553196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 190/393] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:30 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:30.558868 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:30.680902 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:30.689426 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb9e-2c8f-470e-93d7-d38ec3c21f93 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:30.730240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:30.731146 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:30.731433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:30.731710 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/groups/393c6c8467b248d6858d7eeaa12e147e/roles/0aa203eae9c740c5bffcbdf92d4b5712` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:30.734011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] RBAC: Authorizing `identity:create_grant(project_id=3904f00185bf498cb6fa28b7b0f9e0c1, group_id=393c6c8467b248d6858d7eeaa12e147e, role_id=0aa203eae9c740c5bffcbdf92d4b5712)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:30.735468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abba5-bed4-450c-9a9b-187d9e498733 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:30.752091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 204/394] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Jul 15 21:44:30 2022] PUT /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1/groups/393c6c8467b248d6858d7eeaa12e147e/roles/0aa203eae9c740c5bffcbdf92d4b5712 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:31.220791 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e0eb-84a5-454f-a3e1-0f9a9a136a68 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.221784 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e0eb-84a5-454f-a3e1-0f9a9a136a68 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.222297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e0eb-84a5-454f-a3e1-0f9a9a136a68 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.224209 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 191/395] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:31.231198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.232087 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.232553 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.250374 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:31.251919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:31.339083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 205/396] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:31.381561 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e0eb-84a5-454f-a3e1-0f9a9a136a68 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:31.535496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e0eb-84a5-454f-a3e1-0f9a9a136a68 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:31.588301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:31.589523 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.590053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.590539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.602574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-44bb4968-b35d-4bfb-84d0-d9f041d32c79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:31.610853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:31.611726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:31.612605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:31.618565 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 192/397] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:31.622545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:31.718113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:31.746082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d62b-1786-4576-929c-ccf8c3dd640c None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:31.768802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72313-ea0b-4f37-b385-571cd11ad377 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.769112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72313-ea0b-4f37-b385-571cd11ad377 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.769364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72313-ea0b-4f37-b385-571cd11ad377 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.771230 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 193/398] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:31.778604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918e2-8e5e-4c1b-bf75-d8d6a7b4e1a3 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.778897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918e2-8e5e-4c1b-bf75-d8d6a7b4e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.779166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918e2-8e5e-4c1b-bf75-d8d6a7b4e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.803930 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:31.804522 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.804799 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.805069 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.805823 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] RBAC: Adding query filter params (name=member) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:31.806157 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:31.807530 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:31.809795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-592918e2-8e5e-4c1b-bf75-d8d6a7b4e1a3 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:31.811022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-592918e2-8e5e-4c1b-bf75-d8d6a7b4e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:31.827217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:31.830570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 206/399] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:31.835139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:31.941372 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 194/400] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:31.943100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cd57-d040-4f47-a070-30150aa2ab3a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.944150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cd57-d040-4f47-a070-30150aa2ab3a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.944438 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cd57-d040-4f47-a070-30150aa2ab3a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.949977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 195/401] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:31.951718 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:31.952101 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:31.952381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:31.971239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:31.972443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:32.004584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774647-a648-4fc3-8288-95a6c352f644 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.052085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.053105 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.053394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.053673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.055047 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.056446 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.058417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 207/402] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:31 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:32.059190 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.062258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 196/403] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:32.076558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.079727 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.174569 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c066bc-fe02-442b-8214-401013677b98 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.194912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.211327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.212258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.212875 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.212990 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.224847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:32.226767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b481e-cbd4-40ad-af0e-59cdb849f8a7 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:32.233376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:32.234747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:32.235724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:32.241569 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 208/404] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:32.242460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.271643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.273000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.273847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.274547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.276521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.278411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.286932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 197/405] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:32.286932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.323006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.364272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177435a-feb6-4e1e-bf5c-e156cceaa236 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.426522 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.428174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.428808 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.429293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.432594 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292a535-3215-4c65-abd1-76e6b463cac9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.442270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:32.452313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:32.453186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:32.454004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:32.458202 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 209/406] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:32.462620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.483833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.485465 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.486085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.486576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.487796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:32.488645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.490466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.508078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 198/407] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:32.508998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.513549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.599598 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364cd6-f991-4987-ad83-ce74ad7e01df None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.619468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690e9f-8e71-4e84-b95a-82436ebe9c03 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.639521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.648443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.650420 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.650912 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.651623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/groups/393c6c8467b248d6858d7eeaa12e147e/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.654986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, group_id=393c6c8467b248d6858d7eeaa12e147e, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.656895 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.657299 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.658011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.658300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.658579 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.659333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:32.659643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.661124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.677914 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 199/408] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:32.677914 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.683836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 210/409] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Jul 15 21:44:32 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/groups/393c6c8467b248d6858d7eeaa12e147e/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:32.689458 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.818803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:32.891847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3012-8b3c-4046-9071-5afc431ab804 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.913303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7796cb-7a02-4905-a8d2-a5b09fb55c59 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:32.940901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.942407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.943025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.943590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.945146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.946936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.949459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 200/410] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:32.958191 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:32.983385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:32.984277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:32.984566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:32.984926 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] PATH_INFO: `/v3/groups/b266ace7fef242bc983c44adc9be055a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:32.986454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] RBAC: Authorizing `identity:get_group(group_id=b266ace7fef242bc983c44adc9be055a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:32.988300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:32.993962 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 211/411] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/groups/b266ace7fef242bc983c44adc9be055a => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:32.997601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.069058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.097548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d4b08-08ba-46bf-a72c-0b2fb1049a5c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.112415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e295b0-e3ca-409a-ad66-5fb2bfa61318 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.140980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.142202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.142480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.143047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.144595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:33.146299 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355c930-a8b0-4ee9-8999-0cbd6fafdf66 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:33.147816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.148480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 201/412] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:33.148868 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.149259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.149628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] PATH_INFO: `/v3/projects/f982803038e141998f61945f94c1d197` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.149785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28332-72f2-45dd-9478-440d6b8d9a17 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.150094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28332-72f2-45dd-9478-440d6b8d9a17 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.150366 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28332-72f2-45dd-9478-440d6b8d9a17 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.151139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] RBAC: Authorizing `identity:get_project(project_id=f982803038e141998f61945f94c1d197)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:33.151685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 202/413] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:33.152951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba5e6d-3422-40c8-b7e9-90514d4fd13a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:33.159633 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 212/414] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:32 2022] GET /identity/v3/projects/f982803038e141998f61945f94c1d197 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:33.159758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb28332-72f2-45dd-9478-440d6b8d9a17 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.162694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.162694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.162694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.163261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.179836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:33.181039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:33.257982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 213/415] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:33.258924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.294487 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb28332-72f2-45dd-9478-440d6b8d9a17 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.340795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.343168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.343353 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.343620 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27/groups/393c6c8467b248d6858d7eeaa12e147e/roles/0aa203eae9c740c5bffcbdf92d4b5712` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.347092 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.347934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] RBAC: Authorizing `identity:create_grant(project_id=670ea56837f642849cf27aa0b764fb27, group_id=393c6c8467b248d6858d7eeaa12e147e, role_id=0aa203eae9c740c5bffcbdf92d4b5712)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:33.351423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:33.369837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 203/416] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Jul 15 21:44:33 2022] PUT /identity/v3/projects/670ea56837f642849cf27aa0b764fb27/groups/393c6c8467b248d6858d7eeaa12e147e/roles/0aa203eae9c740c5bffcbdf92d4b5712 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:33.371666 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.418577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacd3f6-054a-4587-ba63-563d3bb3956f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.469694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.485057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.486204 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.486581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.486950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] PATH_INFO: `/v3/projects/f982803038e141998f61945f94c1d197/groups/b266ace7fef242bc983c44adc9be055a/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.490162 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f982803038e141998f61945f94c1d197, group_id=b266ace7fef242bc983c44adc9be055a, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:33.492559 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac794f6-8a87-4b98-a8a9-665b68a138c7 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:33.522334 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 214/417] 10.222.0.17 () {58 vars in 1442 bytes} [Fri Jul 15 21:44:33 2022] PUT /identity/v3/projects/f982803038e141998f61945f94c1d197/groups/b266ace7fef242bc983c44adc9be055a/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:33.524743 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5111c3-4cb5-4bb3-bba7-dd5d40f94b5a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.525305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5111c3-4cb5-4bb3-bba7-dd5d40f94b5a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.525591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5111c3-4cb5-4bb3-bba7-dd5d40f94b5a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.527650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 215/418] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:33.535206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.535534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.535844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.537271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a908-af1b-4f62-9fc0-ae4452d7f43e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.576220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:33.577777 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:33.608442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.610043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.611011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.611601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] PATH_INFO: `/v3/roles/member` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.627878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:33.639316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:33.640290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:33.641108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 204/419] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:33.651948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.711415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 216/420] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:33.751639 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.807486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31efa-e632-4866-8004-15cbe149f3db None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.822229 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.833971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:33.847514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.848326 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.848610 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.848884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:33.849787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:33.850325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:33.851948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:33.861674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 205/421] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:33.873854 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:33.922902 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170b9a-92e4-4d4f-8abe-b6b5c9fab7a4 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:33.975779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:33.976954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:33.977600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:33.978537 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.000932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:34.014584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:34.015726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:34.016741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:34.017360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 217/422] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:34.024345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.033816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164626d-099e-41ad-8466-0f6bb4a6608b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:34.097110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:34.098121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:34.100953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:34.101448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.215595 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9609-31a5-402f-909d-3173818ff56a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:34.226180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:34.241900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:34.272244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:34.275291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:34.275743 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:34.276393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.277271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:34.278194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:34.280165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:34.280641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:34.282183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:34.300856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 218/423] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:34.306714 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.428812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 206/424] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:34.430924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.435022 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b72e57-e6c6-4b7f-8df5-6312ec379279 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:34.486310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:34.487083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:34.487191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:34.487450 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.533641 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:34.550689 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9099-a310-44a8-aa90-387703a462f6 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:34.554244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:34.604131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:34.605948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:34.606619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:34.609347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.611013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:34.612701 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:34.615405 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 207/425] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:34.622166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.623137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:34.624789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:34.794194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f250-52d4-4277-835b-c20a2e010fe7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:34.829747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:34.830732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:34.831009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:34.831279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:34.835606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:34.835606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:34.836652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 208/426] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:34.847112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.881725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 219/427] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:34.882903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:34.883962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:35.012945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd838b-e5c7-431b-8b78-91bf1ac340f2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:35.061314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:35.083444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:35.084509 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.085019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.085633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.086766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:35.087288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:35.091082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:35.106175 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 209/428] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:35.117045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e6cd-84b2-474e-80c1-c550e3cc8eb6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:35.158124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:35.159361 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.159834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.160298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] PATH_INFO: `/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.161977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] RBAC: Authorizing `identity:get_project(project_id=3904f00185bf498cb6fa28b7b0f9e0c1)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:35.163732 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:35.170338 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 220/429] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:34 2022] GET /identity/v3/projects/3904f00185bf498cb6fa28b7b0f9e0c1 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:35.172300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:35.274024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:35.295261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e6a8-99d7-48c1-8454-baf49bb9cfe0 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:35.339231 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:35.340047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.340336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.340610 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.342656 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:35.344158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36a95a-d79f-4e0e-b5c8-a957a4ac4d3c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:35.346236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 210/430] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:35 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:35.355055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:35.501156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a075b7-8318-4d6f-b1dd-51166ba1112d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:35.532275 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126cb8-00a4-44ba-954c-debb1f9676ad None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.532823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126cb8-00a4-44ba-954c-debb1f9676ad None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.532823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126cb8-00a4-44ba-954c-debb1f9676ad None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.535855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 211/431] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:35.541093 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.541386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.541705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.543618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:35.544514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.545082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.545639 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.546719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:35.547257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:35.550301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:35.558203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 221/432] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:35 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=3904f00185bf498cb6fa28b7b0f9e0c1&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:35.571291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:35.572548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:35.685138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 212/433] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:35.715931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:35.719011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:35.878154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940832f-7f5b-47dd-b1ce-73a98da06a6e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:35.918479 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:35.919290 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:35.919570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:35.919844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:35.933075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c387fefc-67a7-4186-9977-eebd300d04bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:35.942445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:35.943433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 21:44:35.944242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:35.947174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 222/434] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:35.954193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.057033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.076955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ef135-f3d7-48ce-9d16-3f0b1603b511 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.114084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.114803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.115081 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.115354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.116376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] RBAC: Adding query filter params (name=member) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:36.116733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.118268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.124958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a118c-2d39-488b-9d3b-92f861c93df1 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.125244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a118c-2d39-488b-9d3b-92f861c93df1 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.125523 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a118c-2d39-488b-9d3b-92f861c93df1 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.127074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 223/435] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:36.128403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 213/436] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:36.132295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.132579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.132857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.136203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.151824 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:36.153016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:36.242520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.259644 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 224/437] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:36.286910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.292353 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e06d-2530-4df1-83f8-70fe6945cbcb None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.327257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.327919 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.328266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.328600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.343987 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.393047 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9521-8d11-4b4e-960c-64b760006071 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.399758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.401245 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29aee-0715-4192-9bee-f2480b958f9b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.431465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.432379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.432664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.433016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.444571 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-9c34482d-84bb-4ce8-9d79-2429c9b3acb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:36.452623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:36.453512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:36.454355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 225/438] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:36.455441 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed63e-cc7d-4fe6-a2ac-4497d4f9385a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.455548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed63e-cc7d-4fe6-a2ac-4497d4f9385a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.455745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed63e-cc7d-4fe6-a2ac-4497d4f9385a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.457123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 226/439] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:36.459942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed63e-cc7d-4fe6-a2ac-4497d4f9385a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.517629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 214/440] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 21:44:36.517629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.517629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.517629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.523459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.532008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:36.533208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:36.571687 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.572419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed63e-cc7d-4fe6-a2ac-4497d4f9385a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.599587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 215/441] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:36.600415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.613192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.614262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.614703 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.615112 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.615880 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:36.616206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.618142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.627732 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 227/442] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:36.628567 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.703923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf265-33e4-4322-92aa-3b02f66973a6 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.729173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2ad2-e18e-47b8-8050-5db457ac904f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.740518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.741402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.741684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.741995 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.742400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.743518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.745035 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.746811 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 216/443] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:36.747597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.763930 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.764718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.764996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.765256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.777773 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:36.785816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:36.786969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:36.787816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 228/444] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:36.788493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.796765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:36.853699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbf5f-4fd3-4f25-b8a1-3b5af7a4c8ef None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.888549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.889231 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.889513 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.889788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.890493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065f556-f533-4711-bdd6-ff7ba28d229f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:36.924617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:36.925464 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:36.925742 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:36.926046 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:36.927365 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.928821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.930473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 229/445] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:36.931261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:36.958568 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:36.960350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:36.972585 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.002500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.028659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea9e0-a11c-4304-8163-dbf032a0cc33 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.061553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 217/446] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:37.062462 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.062789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.063439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.063716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.063987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.064730 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:37.065027 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.066583 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.075097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 230/447] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:37.075788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.167083 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d440-bbf7-400b-89cc-c195698cfaeb None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.177699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a0b-4966-47ab-9f16-5fdfb1d69cb1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.180117 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.201537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.202227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.202513 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.202789 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.203623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=54adb043b23b4378ad3430fdd81e36bd, scope.project.id=670ea56837f642849cf27aa0b764fb27) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:37.203938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.205363 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.211216 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.211738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 218/448] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=54adb043b23b4378ad3430fdd81e36bd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:37.212150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.212490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.212590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.212764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] PATH_INFO: `/v3/projects/670ea56837f642849cf27aa0b764fb27` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.217609 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] RBAC: Authorizing `identity:get_project(project_id=670ea56837f642849cf27aa0b764fb27)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.219103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.220923 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 231/449] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/projects/670ea56837f642849cf27aa0b764fb27 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:37.226633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.227080 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.338037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465a19-c9da-41a5-9bff-cb0e2ce913f5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.347122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e10e-8957-486b-85cd-809c2cef71e5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.380107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.381003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.381289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.381563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.392130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.393525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.394061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.394133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] PATH_INFO: `/v3/groups/393c6c8467b248d6858d7eeaa12e147e` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.398601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] RBAC: Authorizing `identity:get_group(group_id=393c6c8467b248d6858d7eeaa12e147e)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.398859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.401175 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 232/450] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/groups/393c6c8467b248d6858d7eeaa12e147e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:37.407172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.463126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.464839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.465438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.475325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.535241 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956805d5-2cf6-4676-968c-ce5a88747d2a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.579772 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.580527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.580894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.581238 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.582125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] RBAC: Adding query filter params (group.id=393c6c8467b248d6858d7eeaa12e147e, role.id=0aa203eae9c740c5bffcbdf92d4b5712, scope.project.id=670ea56837f642849cf27aa0b764fb27) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:37.582437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.583927 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.589119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 219/451] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:37.590986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 233/452] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/role_assignments?group.id=393c6c8467b248d6858d7eeaa12e147e&scope.project.id=670ea56837f642849cf27aa0b764fb27&role.id=0aa203eae9c740c5bffcbdf92d4b5712 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:37.594314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.704566 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e4d2c-9aec-4587-9e4f-4ed5109b1bdd None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.713529 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.743971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.744871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.745157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.745436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] PATH_INFO: `/v3/projects/f982803038e141998f61945f94c1d197` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.746787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] RBAC: Authorizing `identity:get_project(project_id=f982803038e141998f61945f94c1d197)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.748321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.750192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 220/453] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/projects/f982803038e141998f61945f94c1d197 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:37.756498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:37.885782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018d11-5d62-4e9e-bcfd-0031f762c84b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:37.888184 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:37.921811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:37.922708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:37.922989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:37.923256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] PATH_INFO: `/v3/groups/b266ace7fef242bc983c44adc9be055a` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:37.924452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] RBAC: Authorizing `identity:get_group(group_id=b266ace7fef242bc983c44adc9be055a)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:37.925920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dbc4a-629e-4b58-a782-3878615e997f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:37.927597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 234/454] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/groups/b266ace7fef242bc983c44adc9be055a => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:37.935623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:38.039505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f4ab-32c6-4beb-9efe-46c874cf1baa None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:38.076479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:38.077125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:38.077407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:38.077718 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:38.078724 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] RBAC: Adding query filter params (group.id=b266ace7fef242bc983c44adc9be055a, role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=f982803038e141998f61945f94c1d197) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:38.079033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:38.080476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6a8d-bdc4-4200-bee8-05951737bb4a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:38.086494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 221/455] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Jul 15 21:44:37 2022] GET /identity/v3/role_assignments?group.id=b266ace7fef242bc983c44adc9be055a&scope.project.id=f982803038e141998f61945f94c1d197&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:40.624579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad6d0-b63e-4539-bc41-a81a695d6480 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.625631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad6d0-b63e-4539-bc41-a81a695d6480 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.626201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad6d0-b63e-4539-bc41-a81a695d6480 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.628245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 235/456] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:40.634775 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dc8b4-f8af-4237-b0b2-930dc1b03f3d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.635749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dc8b4-f8af-4237-b0b2-930dc1b03f3d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.636215 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dc8b4-f8af-4237-b0b2-930dc1b03f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.655178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-884dc8b4-f8af-4237-b0b2-930dc1b03f3d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:40.656705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-884dc8b4-f8af-4237-b0b2-930dc1b03f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:40.689190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:40.729821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 222/457] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:40.755724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad6d0-b63e-4539-bc41-a81a695d6480 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:40.801167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2140ee-60ee-4513-aff7-4d3432fd724c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.801798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2140ee-60ee-4513-aff7-4d3432fd724c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.802400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2140ee-60ee-4513-aff7-4d3432fd724c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.804356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 223/458] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:40.813027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac262-56fa-4f2e-9743-ee1935479d81 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.813381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac262-56fa-4f2e-9743-ee1935479d81 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.813595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac262-56fa-4f2e-9743-ee1935479d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.837366 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-b0aac262-56fa-4f2e-9743-ee1935479d81 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:40.838608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b0aac262-56fa-4f2e-9743-ee1935479d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:40.883487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad6d0-b63e-4539-bc41-a81a695d6480 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:40.925961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 224/459] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:40.928183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:40.929206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.929700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.930270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.941417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:40.943455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:40.946767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068942ea-97f8-488d-9073-98b165a67406 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.947062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068942ea-97f8-488d-9073-98b165a67406 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.947348 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068942ea-97f8-488d-9073-98b165a67406 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.948989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 225/460] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:40.949684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068942ea-97f8-488d-9073-98b165a67406 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-171ebc2c-86eb-4352-b472-123ac765b002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:40.963203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:40.964245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:40.965287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:40.965287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:40.965287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:40.965287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:40.966857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 236/461] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:40.968167 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:40.968584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:40.968989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:40.985979 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:40.987193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:41.005104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.064871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.071919 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068942ea-97f8-488d-9073-98b165a67406 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.073267 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 237/462] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:41.074671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.120789 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.121610 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.121926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.122211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.139345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.140863 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:41.160016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:41.160905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:41.162056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:41.162056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:41.162056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:41.162056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:41.162056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 226/463] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:41.163107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.199247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902c5a2-4ecc-4f96-8039-97c63ffba86e None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.236137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.236828 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.237105 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.237384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.238155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:41.238465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.239946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.257752 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 238/464] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:41.258681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.273207 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856577f-6b84-475b-b44d-5d9a17d98bbc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.274991 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.310738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.311544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.311824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.312105 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.322545 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.324030 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-b672f4a0-c9b5-4322-a098-b1ab5c15b9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:41.342036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:41.342916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:41.343790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:41.343790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:41.343790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:41.343790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:41.343790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 227/465] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:41.344454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbbc8-7909-4ed6-a859-bd7c83cf6663 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.344711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbbc8-7909-4ed6-a859-bd7c83cf6663 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.344987 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbbc8-7909-4ed6-a859-bd7c83cf6663 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.346266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 228/466] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:41.346938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbbc8-7909-4ed6-a859-bd7c83cf6663 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.349800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.367779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc53ae-853c-4e0c-bb4f-ecfbd68db989 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.402328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.403003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.403270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.403546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.405781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:41.406146 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.407538 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.419520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 239/467] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:41.420381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.468344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbbc8-7909-4ed6-a859-bd7c83cf6663 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.499932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.505295 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.506004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.506287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.506557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.507261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.508701 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752da00d-0580-4bd0-bcdd-366b68d0a2e1 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.525499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9b61-a978-423e-8b3c-ffc1d8e1bef2 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.528519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 229/468] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:41 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:41.530172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.530458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.530716 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.548979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:41.550257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:41.574529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.575747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.576093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.576376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.577118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:41.577430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.578856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.597124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 240/469] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:41.598142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.615278 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.633380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 230/470] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:41.634536 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.724624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632763-6cc7-49b7-9de3-58c4ee7dbdcb None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.760223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe732-eff5-459f-8c90-7ae69a8f408b None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.768147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.768828 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.769112 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.769381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.770129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.771655 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.778546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:41.792474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 241/471] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:41 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:41.793482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:41.801084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.801785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.802296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.802723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.803452 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.805008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:41.828717 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 231/472] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:41 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:41.932607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3b7b9-576b-4ec6-bbe7-3c3155a899f6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:41.973467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:41.974391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:41.974746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:41.974947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:41.989048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:41.991020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:42.011416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:42.012333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:42.013155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:42.013155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:42.013155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:42.013155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:42.013155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 242/473] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:42.018822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:42.072825 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:42.135225 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645ce2-bad9-4dc9-b669-c94a29e88883 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:42.175063 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:42.175743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:42.176026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:42.176300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:42.177062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:42.177832 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:42.179368 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc70b51-83ba-426a-adc9-055eff1f72e8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:42.192068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 232/474] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:42.197301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:42.243106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:42.304765 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f35fd1-b4d8-4747-8e65-d2bd77f3032c None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:42.341802 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:42.342513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:42.342794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:42.343065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:42.343789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:42.345233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775ff4-056a-437f-9fcb-b316294dc6e8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:42.369447 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 243/475] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:44:42 2022] POST /identity/v3/users => generated 249 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:44:43.812161 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceeef-1593-4fe2-98d7-1f31d47ac4d4 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:43.812697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceeef-1593-4fe2-98d7-1f31d47ac4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:43.812697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceeef-1593-4fe2-98d7-1f31d47ac4d4 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:43.814248 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 233/476] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:43.819539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:43.819947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:43.820118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:43.839074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:43.840287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:43.917978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 244/477] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:43.938773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceeef-1593-4fe2-98d7-1f31d47ac4d4 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.047270 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceeef-1593-4fe2-98d7-1f31d47ac4d4 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.049805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.097338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.098097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.098379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.098651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.111140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-161c9e2e-0c44-4d86-8171-dc39c49e472b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:44.119329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:44.120306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:44.121140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 234/478] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:44.127108 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.159122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.224686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c7-a915-44c8-96c2-55c2509e2598 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.224973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c7-a915-44c8-96c2-55c2509e2598 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.225261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c7-a915-44c8-96c2-55c2509e2598 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.227019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 235/479] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:44.232220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745104d-494f-46e4-bb1a-206fdcadc164 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.232501 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745104d-494f-46e4-bb1a-206fdcadc164 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.232780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745104d-494f-46e4-bb1a-206fdcadc164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.242880 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae8d-dede-407d-ab7c-7f5d220d5fc0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.250006 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-6745104d-494f-46e4-bb1a-206fdcadc164 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:44.251214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6745104d-494f-46e4-bb1a-206fdcadc164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:44.282462 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.283131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.283413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.283684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.284445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:44.284760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:44.286166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:44.295750 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 245/480] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:44.307728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.329297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 236/481] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:44.330660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecaec-a8de-4517-9ca1-eca0cfebbada None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.330945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecaec-a8de-4517-9ca1-eca0cfebbada None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.331218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecaec-a8de-4517-9ca1-eca0cfebbada None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.332630 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 237/482] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:44.338030 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.338601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.339071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.360292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:44.361392 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:44.424695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.435791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeae09-f986-4b3c-956a-95bc6c04f1a0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.441888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 238/483] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:44.442605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.478282 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.493572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.494402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.494682 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.494954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.506452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:44.507996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:44.525429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:44.526354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 246/484] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:44.532477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.569064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ad9ce-3c0c-4c9d-8853-3871e80c8e07 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.607069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.607880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.608158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.608429 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.619955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:44.627843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:44.628756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:44.629553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 239/485] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:44.630271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.639940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cc2d-7df5-461a-91f5-c90bae291abc None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.676143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.677426 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.677936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.678382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.690405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:44.698717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:44.699591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:44.700405 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 247/486] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:44.701120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.704723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.730427 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.747053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c700c63-8288-47fe-a71c-6cd0500da868 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.781099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.781764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.782082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.782375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.783091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:44.783397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:44.784797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:44.796342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 240/487] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:44.797131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.803332 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bcac-0c31-424e-a1fb-5eff5bfb361b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.837848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.838508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.838809 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.839084 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.839834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:44.840144 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:44.841523 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089eb4-4a7c-4de5-9b59-071218834afd None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:44.849985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 248/488] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:44.851190 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131e57e-6fab-4024-abe4-3f4edb49cd40 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.851480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131e57e-6fab-4024-abe4-3f4edb49cd40 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.851758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131e57e-6fab-4024-abe4-3f4edb49cd40 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.853010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 249/489] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:44.857061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131e57e-6fab-4024-abe4-3f4edb49cd40 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.899936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5330f4-5a64-40f6-8637-f7e25732c65b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.917748 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.934380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.935068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.935355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.935633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:44.936388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] RBAC: Adding query filter params (name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:44.936697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:44.938302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:44.946556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 241/490] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:44.947432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:44.955846 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:44.960063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131e57e-6fab-4024-abe4-3f4edb49cd40 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:44.996057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:44.996852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:44.997135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:44.997409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.004506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.006180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-02d3ac9c-f036-4039-8ed5-af59121e2e14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:45.021641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:45.022637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:45.023527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 250/491] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:45.024556 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.024795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.025068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.043296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:45.044477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:45.052682 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a823bd-fb40-486f-8fee-0835e9537c5a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.089835 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.090961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.091236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.103068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.104599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.114262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 251/492] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:45.115348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:45.121688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:45.122654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:45.123643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:45.123643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:45.123643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:45.123643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:45.123643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 242/493] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:45.123967 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.184165 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.189016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.233100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a102-86b6-48ce-a44c-da8e3b292713 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.234096 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46835-ba1c-4ee4-8413-fc6b29f85d93 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.270623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.271463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.271678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.271968 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.272144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.272244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.272436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.273364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.273578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:45.273896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.278376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.286625 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.288083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:45.308884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:45.309992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:45.310861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:45.310861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:45.310861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:45.310861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:45.310861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 252/494] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:45.311136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.317198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 243/495] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:45.318156 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.428195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b92ce-88af-4e66-b2e5-ba0e88dc6465 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.435093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055009-14a1-4fa1-a04d-bc758b9106d0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.444681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.449586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.472378 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.473187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.473471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.473753 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.474370 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.475066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.475513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.475839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.476580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:45.476892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.478534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.485038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:45.490754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 253/496] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:45.491596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:45.493256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:45.494516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:45.495317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 244/497] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:45.495963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.601939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa341-b0c3-4525-b746-a8f05eff6ab0 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.602501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b168-c489-43b0-899e-0c95a575c629 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.635570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.636224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.636506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.636779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.637060 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.637725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.638762 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.638762 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.639133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:45.639444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.640828 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.653757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 254/498] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:45.655022 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.681760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.691309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.722182 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.723975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.759493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2224-73dc-406d-858a-31d418739a44 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.795500 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.796273 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.796591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.796864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.806005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.807449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:45.823012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:45.823974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:45.824852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 255/499] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:45.825397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.840353 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 245/500] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:45.841218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:45.926909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.933082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:45.949545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c382e-67cb-4ca9-b3c3-8954ee858fc8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.955153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f027-def9-4220-9d56-ef22a7d60a96 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:45.985638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.986785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.987068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.987341 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.988097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:45.988407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:45.989899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:45.991310 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:45.992110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:45.992391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:45.992664 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:45.998255 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 256/501] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:45.999074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.004535 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.006237 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:46.023719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:46.024870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 246/502] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:46.025884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.107517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5af84-d6f9-48ae-a72d-a910b3e45232 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.134888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb74f-c9c7-4418-861a-ce263b8b5f0b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.148829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.149415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.149725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.150020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.150856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:46.151152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.152606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.170946 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.171755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.172035 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.172293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.175057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.183871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.185340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.189839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 257/503] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:46.190724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.199643 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:46.204337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:46.205194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:46.206060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:46.206060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:46.206060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:46.206060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:46.210263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 247/504] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:46.211109 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.291452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906404ff-c0fe-472f-91b2-93ff56b6d215 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.312527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf879a-cc09-4640-b856-dd2313871d61 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.326887 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.327702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.327985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.328260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.340004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.341543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.347475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.348161 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.348444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.348723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.349692 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:46.350064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.351491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:46.359207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:46.360059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:46.360881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:46.360881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:46.360881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:46.360881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:46.360881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 258/505] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:46.361367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.372866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 248/506] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:46.373694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.426308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.427747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.470613 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fc66-5c36-4403-8627-7989eeb56b02 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.480352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657da27-e3ec-4623-889f-0d08a52b0953 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.503521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.504184 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.504463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.504734 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.513411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76526478-097a-4cd7-b141-147502676685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.514122 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76526478-097a-4cd7-b141-147502676685 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.514410 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76526478-097a-4cd7-b141-147502676685 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.514690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76526478-097a-4cd7-b141-147502676685 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.515418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76526478-097a-4cd7-b141-147502676685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:46.515729 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76526478-097a-4cd7-b141-147502676685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.517156 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76526478-097a-4cd7-b141-147502676685 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.529759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 249/507] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:46.530627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76526478-097a-4cd7-b141-147502676685 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.573278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.574805 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.631925 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76526478-097a-4cd7-b141-147502676685 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.632441 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.639066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.669424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.670116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.670398 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.670662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.671377 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:46.671681 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.673066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.674730 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 259/508] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:46.675575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.689654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 250/509] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:46.690631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.779920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d6ed-a1ec-47ca-9178-b958e08262a4 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.787918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd09d-d31e-4728-a4a8-943554974209 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.813659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.814341 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.814624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.814900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.820402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.821188 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.821469 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.821743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.828301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.829736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.841539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:46.843713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:46.844705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:46.845699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 251/510] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:46.846326 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.874309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:46.887574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.889069 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:46.945876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710898-fa08-4509-b656-9e6b5b12998f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:46.979676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:46.980558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:46.980806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:46.981125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:46.987584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 260/511] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:46.988447 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:46.992561 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:46.994183 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:47.011251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:47.012099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:47.012937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:47.012937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:47.012937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:47.012937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:47.012937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 252/512] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:47.013257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.047113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.087324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c111-5bec-463f-8e36-ee3fd2ca01c3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.091511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.112938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c713-7618-478e-924c-0cb8f35a8f47 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.121342 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.122172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.122452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.122726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.129757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.131323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.145479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:47.145614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:47.146570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:47.147642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:47.148162 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.148239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 261/513] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:47.148305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.148305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.148554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.148629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.148770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.150197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.171117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 253/514] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.171973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.266480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ad8e-dbff-411f-9ded-5d73603aa4a3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.282609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b80a-b8fa-4aff-8d43-19bbf953a26f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.284765 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.306637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.307356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.307633 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.307902 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.318669 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.320118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.322925 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.323597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.323884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.324160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.324919 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.325229 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.326640 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.333060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:47.337339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:47.338295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:47.339140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:47.339140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:47.339140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:47.339140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:47.339140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 262/516] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:47.339405 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 254/516] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.339473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.339545 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.448455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8063-1f93-46d5-a295-94b16ac3d196 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.449954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80135428-9874-4b46-8687-0ba5b9239e00 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.485542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.486212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.486329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.486516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.486797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.486904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.487146 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.487419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.487636 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=580e48715b944a32a3b1218de325b996) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.487953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.488253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.488560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.489495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.490218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.495722 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 255/517] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/role_assignments?user.id=580e48715b944a32a3b1218de325b996&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.496508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.508712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 263/518] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.509580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.546282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.606058 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.629735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafddc-7ac9-464a-a2ca-cd610d533834 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.650930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210f6e-2698-4709-9c58-0d079c7d5741 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.670237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.671068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.671332 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.671608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.680485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.683091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.692165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.692875 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.693150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.693425 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.694357 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.694685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.696044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:47.700313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:47.701128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:47.702100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:47.706606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 264/519] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:47.707300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.713245 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 256/520] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.713245 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.807750 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.820465 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3cf0-e260-4920-af95-01c900807108 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.821403 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37504-f16e-4fec-b83e-a7071633e837 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:47.845046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:47.859430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.860096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:47.860684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.860808 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:47.861009 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.861284 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.861660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:47.862254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:47.863257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:47.863874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.866292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.879235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 257/521] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:47.879976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:47.936370 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:47.937919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:47.989582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb57a7-1073-4e5f-b910-440297cc4bc1 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.027301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.028108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.028396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.028676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.034118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.038507 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.039980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.053940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 265/522] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:48.053940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:48.054530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:48.055334 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:48.057038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 258/523] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:48.057502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.104537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.161257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f858-8a78-4e1f-be88-f94abcf67f88 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.164500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb25e1-3d43-4929-b299-2fe3e16cbb40 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.196872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.197532 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.197814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.198137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.198971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=d66fa72ed4554daaa34a0fe6f5d6f8ca) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.199085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.199284 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.199769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.200052 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.200328 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.200726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.218194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 266/524] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/role_assignments?user.id=d66fa72ed4554daaa34a0fe6f5d6f8ca&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:48.218194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.223644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.225385 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:48.246923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:48.248200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:48.249338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:48.249338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:48.249338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:48.249338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:48.249338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 259/525] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:48.255655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.280252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.335901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b13f-f69d-4791-b942-3b300119e18f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.374292 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.375132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.375514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.375910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.376810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.377220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.378909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.392354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.401494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686567-9758-429f-9174-dd84884d2fcc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.405766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 267/526] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:48.406777 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.441039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.442949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.443438 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.443905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.444976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.445470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.447100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.461745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 260/527] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:48.467352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.523293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01f1a-8d4d-43e7-b4f8-de95a8d420f0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.538548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.562254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.562913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.563194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.563469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.564416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=c0e23da86db744f88719c5511226d9a7) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.564591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.566114 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.578195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 268/528] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/role_assignments?user.id=c0e23da86db744f88719c5511226d9a7&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:48.591836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3fd8e-3cf6-43b6-a57d-9f2c72f767c2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.631860 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.633127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.633626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.634167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.643369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.645287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:48.661900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:48.662815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:48.663646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:48.666353 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 261/529] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:48.672462 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.786091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d3fb8-aac4-45f4-86c9-3e4a1dd3da8a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.820752 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.821767 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.822271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.822779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.823749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.824268 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.825917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38234395-e2be-4595-91a4-1d75453c9e1a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:48.839837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 269/530] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:48.846119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:48.863279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:48.951876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece7c0-1536-4adb-930c-8810956043f8 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:48.987988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:48.989011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:48.989570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:48.990234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:48.991933 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=661831a6f5214520a43b84201a4588db) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:48.992470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:48.994143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a9022-2e0d-4b9f-909b-ba39fcf4ed33 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:49.000829 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 262/531] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:48 2022] GET /identity/v3/role_assignments?user.id=661831a6f5214520a43b84201a4588db&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:49.764582 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51863-a685-418e-98cc-d13613275811 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:49.765119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51863-a685-418e-98cc-d13613275811 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:49.765119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51863-a685-418e-98cc-d13613275811 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:49.766773 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 270/532] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:49.773385 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:49.773677 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:49.773999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:49.792132 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:49.793332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:49.861592 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 263/533] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:49.884634 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51863-a685-418e-98cc-d13613275811 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:49.923993 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.002774 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51863-a685-418e-98cc-d13613275811 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.038631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.039757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.040229 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.040733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.051570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:50.059744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:50.060672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:50.061463 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:50.064182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 271/534] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:50.069996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.082182 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.176534 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5248b-91e8-4f2a-b23e-4d1919c07fe4 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.213692 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.214411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.214697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.215005 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.215757 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] RBAC: Adding query filter params (name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:50.216060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:50.217439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:50.230668 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 264/535] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:50.236300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.345131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.351066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137551-571a-4caf-b1d9-715abf1fb6f3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.390794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.391119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.391223 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.391498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.403966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:50.405832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-b850d012-1c5b-477c-b088-df6773b55da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:50.424576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:50.425552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:50.426702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:50.426702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:50.426702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:50.426702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:50.426702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 272/536] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:50.432056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.503466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.536504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a3e2-d720-483b-9257-ae29d313ed87 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.536854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a3e2-d720-483b-9257-ae29d313ed87 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.537044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a3e2-d720-483b-9257-ae29d313ed87 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.538706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 273/537] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:50.539694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df4ac-4828-4569-afaf-e45b878a5779 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.546646 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.547145 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.547571 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.568242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:50.569819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:50.585700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.586745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.587121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.587512 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.588585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:50.589346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:50.590839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:50.608837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 265/538] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:50.614125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.649891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 274/539] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:50.673481 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.720588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3009-68ee-40de-8b92-b0ccac5f8a68 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.754455 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.763978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.764812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.765108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.765447 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.774617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:50.775160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:50.776167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:50.793964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:50.794949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:50.795855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:50.800141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 266/540] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:50.801039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.807181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe64a-0448-440b-a27b-0d7d7ac62199 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.852445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.853843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.854554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.855412 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.870193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:50.880708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:50.881620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:50.882454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:50.884073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 275/541] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:50.889074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:50.914927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a629e-cc45-4784-b2bb-c05e4d405434 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:50.952856 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:50.953536 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.953818 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.954161 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.955002 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:50.955308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:50.956749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba17a9-5505-4db3-86f0-dcb9c2f9d189 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:50.975600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 267/542] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:50.981361 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370c6e-c75d-4318-b645-fccaf31973a6 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:50.981780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370c6e-c75d-4318-b645-fccaf31973a6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:50.982164 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370c6e-c75d-4318-b645-fccaf31973a6 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:50.986008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 268/543] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:50.986008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce370c6e-c75d-4318-b645-fccaf31973a6 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.000030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec112f-7bc7-4644-9684-f27591a15117 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.037268 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.037972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.038261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.038540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.039085 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.039295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:51.039618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.041003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89a956-8530-4502-bf78-b7df78ce7bfb None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.046513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.051020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 276/544] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:51.052818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.053068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.053302 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.071354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:51.072565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:51.101958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce370c6e-c75d-4318-b645-fccaf31973a6 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.136766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.137488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.137768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.138073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.149886 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 277/545] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:51.149886 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.150339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.150339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:51.169027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.170190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.171555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:51.171555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:51.171555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.171555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:51.174998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 269/546] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.175828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.267891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2850387-783e-483c-9e23-97a6846d7925 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.278670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.282729 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111e1c-e308-43ad-8e44-c7180f9e9590 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.309789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.321901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.322984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.323271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.323490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.323610 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.324384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.324680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.324961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.335549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:51.339557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.341065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:51.343521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.344375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:51.345179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 270/547] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.347296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-5da4af46-c772-4d43-ac60-5713f39fcaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:51.366123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.367250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.368258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:51.368258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:51.368258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.368258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:51.368258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 278/548] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.368859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eee22f-827a-47f0-9766-e5c4a31e0f2e None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.369146 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eee22f-827a-47f0-9766-e5c4a31e0f2e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.369426 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eee22f-827a-47f0-9766-e5c4a31e0f2e None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.370724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 279/549] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:51.374848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eee22f-827a-47f0-9766-e5c4a31e0f2e None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.475169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55ec8-8ea0-4ac9-9ac0-ec979f254f1c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.487608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eee22f-827a-47f0-9766-e5c4a31e0f2e None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.510153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.510827 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.511113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.511396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.512127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:51.512441 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.513837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.523056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.523721 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.524001 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.524280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.525027 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:51.525341 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.526137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 271/550] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:51.526725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec39603-ae62-41a7-8002-527fa7bc5287 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.526929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.535468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 280/551] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:51.537454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.537760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.538087 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.550356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.555323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:51.556527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:51.598131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.626933 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 281/552] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:51.630843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.632274 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067561c8-256f-4b43-9815-0027a76172a0 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.667662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.668337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.668624 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.668903 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.669626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:51.669973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.671490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.682771 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 272/553] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:51.683561 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.731888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855738-3c58-48e1-afee-a37f0626c73d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.764923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.765748 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.766506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.766884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.767198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.774428 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.775904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.786173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5fa2-759e-44a1-bcb0-124d1b906d2b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:51.790218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.791115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 282/554] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.792327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.821211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.822056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.822342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.822653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.828681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:51.834541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:51.835988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:51.853121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.854202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.855246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:51.855246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:51.855246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:51.855246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:51.855246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 273/555] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.855559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:51.908576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa016-9bbf-4c18-8433-6b016eb027c3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.947608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:51.948334 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:51.948621 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:51.948902 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:51.960900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:51.972139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:51.973263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:51.974662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:51.975661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef910-5342-46a3-a3e2-b4f541402cc2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:51.975738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 283/556] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:51.975738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.009905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.015480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.016290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.016575 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.016852 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.025293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.026793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:52.041346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:52.042468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 274/557] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:52.043958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.073182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.080335 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41479300-63f9-4f81-bdec-63d955036b90 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.112718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.113377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.113654 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.113957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.114821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.115126 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.116554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.128272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 284/558] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.129061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.149485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0a66-6041-41ad-bf7f-272cda263785 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.183982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.184645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.184913 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.185189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.185942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.186254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.187630 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.199568 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 275/559] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.200296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.228844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220587-b723-45a4-803a-8a398f8d1623 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.258659 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.272165 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.272920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.273205 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.273482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.274301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.274612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.276028 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.285048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 285/560] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.285830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.310904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc28ac-12a4-4f55-934f-f7a7dd95158a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.311701 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.346504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.347186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.347475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.347755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.348599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.349057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.350809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.368976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 276/561] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.369792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.393916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767f50-e8e6-44d2-8b85-038fe1c811f0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.435017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.435918 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.436213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.436489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/580e48715b944a32a3b1218de325b996/roles/6f1030b115384d4d8d1b2c36d50d5c02` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.452485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=580e48715b944a32a3b1218de325b996, role_id=6f1030b115384d4d8d1b2c36d50d5c02)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.453888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.467043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 286/562] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:52 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/580e48715b944a32a3b1218de325b996/roles/6f1030b115384d4d8d1b2c36d50d5c02 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:52.473010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dfea8-4676-434a-a55f-a032987620eb None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.474512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.485915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.517059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.517974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.518267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.518549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.527871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.529726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:52.546763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:52.547876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:52.548802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 277/563] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:52.550024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.559775 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.610428 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15cc5-d6d9-4c1e-8a52-361f65c8d980 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.647903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.648820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.649099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.649964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.666443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.668442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.673933 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d95f-c316-4b67-868b-286736f5327b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:52.687631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:52.689288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:52.690632 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:52.690632 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:52.690632 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:52.690632 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:52.690632 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 287/564] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:52.691246 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.721562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.722422 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.722774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.723112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.735273 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.736823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:52.756227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:52.757401 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:52.758540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:52.758540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:52.758540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:52.758540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:52.759453 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 278/565] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:52.760125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.790059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.811370 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1f97-32f5-46a1-a774-8e05b4d37a79 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.829529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:52.846815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.847486 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.847766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.848041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.848923 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.849235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.850722 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.873517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 288/566] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.873517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.881768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5c94-c889-42e6-bbd7-6301524da10f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:52.920705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:52.921635 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:52.921944 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:52.922221 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:52.923202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:52.923871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:52.925263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:52.939892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 279/567] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:52.940616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:52.985177 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba4a9-047f-423e-9f20-5dc5de3f4a7c None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.020048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.020761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.021044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.021308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.022068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:53.022372 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.023740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.034914 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.035854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 289/568] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:53.037108 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.059469 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be83-28e8-4dfa-9d8d-ca31dae857c3 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.085111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.095988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.096795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.097186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.097463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.111723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.113620 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:53.137115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:53.138340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 280/569] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:53.144019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.153531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e8bd-b28a-41bc-b896-788dbb4292af None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.189749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.190603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.190888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.191162 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.200729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.202239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:53.216785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:53.217733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:53.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 290/570] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:53.219395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.256992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17addd78-edbb-4dbe-ab05-af386b0d0a5d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.292876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.293688 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.294003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.294280 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.296204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.302598 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.304378 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.318206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:53.320415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:53.321643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 281/571] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:53.322766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.329296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ed0d3-e658-4fd1-90a4-91b1678a8edc None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.363440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.364123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.364419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.364690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.365403 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:53.365706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.367115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.378899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 291/572] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:53.379593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.441323 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525713-f16d-4dff-a854-d404abc3a7a5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.477733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.478436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.478714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.478987 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.479823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:53.480141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.481578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.492618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3312e-0841-4d19-b40e-c7dee64d0341 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.500118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 282/573] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:53.500853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.536937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.538220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.538707 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.539198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.541178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:53.541515 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.543034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.555305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 292/574] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:53.556416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.565261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.576513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.624663 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1962-a211-4db6-a195-985fe7d56b12 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.661899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.662714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.662999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.663272 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.670546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.671998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:53.686290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:53.687244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:53.688129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 283/575] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:53.688618 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.696134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064168e-9084-48cf-8d31-328fd450f5f6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.731661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.732466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.732928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.733042 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.744771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.746369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:53.764150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:53.765217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:53.766363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:53.766363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:53.766363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:53.766363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:53.767932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 293/576] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:53.769612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.800477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762fe8-e33c-4b93-b28e-94cfa60e0419 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.814324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.837927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.838908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.839154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:53.839601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.839601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/d66fa72ed4554daaa34a0fe6f5d6f8ca/roles/6f1030b115384d4d8d1b2c36d50d5c02` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.855751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=d66fa72ed4554daaa34a0fe6f5d6f8ca, role_id=6f1030b115384d4d8d1b2c36d50d5c02)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.857251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.876743 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3b73-dcfa-4a10-ba9e-23b65a8288d8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:53.877953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 284/577] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:53 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/d66fa72ed4554daaa34a0fe6f5d6f8ca/roles/6f1030b115384d4d8d1b2c36d50d5c02 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:53.878927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:53.917601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:53.918349 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:53.918714 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:53.919067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:53.919945 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:53.920320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:53.921887 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:53.940751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 294/578] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:53.942123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:54.062574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb076c9-e094-4233-a256-24aafbc10c23 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:54.073363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4d3b-205a-4680-b97e-ccda5a6f07e1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:54.109094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:54.123314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:54.124223 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.124509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.124788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/c0e23da86db744f88719c5511226d9a7/roles/6f1030b115384d4d8d1b2c36d50d5c02` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.125977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:54.126736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.127015 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.127288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.128025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:54.128336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:54.129718 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:54.142975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 285/579] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:54.145593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=c0e23da86db744f88719c5511226d9a7, role_id=6f1030b115384d4d8d1b2c36d50d5c02)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:54.147504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:54.149089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:54.167619 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 295/580] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:53 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/c0e23da86db744f88719c5511226d9a7/roles/6f1030b115384d4d8d1b2c36d50d5c02 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:44:54.194929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:54.293068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051efdb-ac63-49e6-946f-2defbe56ec4d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:54.338322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:54.339065 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.339355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.339637 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.347873 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:54.350305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:54.367131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:54.368070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:54.368947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 286/581] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:54.374557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:54.498955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1cb9-6811-4e77-afe4-be572e0a085e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:54.537263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:54.538232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.538695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.539134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.540071 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:54.540527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:54.542154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed0e5-2833-4b27-8386-e5de8d286d62 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:54.555685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 296/582] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:54.561804 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:54.655747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:54.675349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f33ac-4b2a-43d6-b2c5-800af4995e39 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:54.712905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:54.713884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.714177 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.714458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/661831a6f5214520a43b84201a4588db/roles/6f1030b115384d4d8d1b2c36d50d5c02` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.731394 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=661831a6f5214520a43b84201a4588db, role_id=6f1030b115384d4d8d1b2c36d50d5c02)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:54.732893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:54.747502 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15cacc-bc04-4e41-846e-816fd3ff5cb6 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.747795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15cacc-bc04-4e41-846e-816fd3ff5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.748078 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15cacc-bc04-4e41-846e-816fd3ff5cb6 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.749646 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 297/583] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:54.754609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 287/584] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:44:54 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/661831a6f5214520a43b84201a4588db/roles/6f1030b115384d4d8d1b2c36d50d5c02 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:44:54.755618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:54.756120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:54.756841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:54.776444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:54.777996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:54.813978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:54.863122 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 298/585] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:44:54.888474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:54.999365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bad2-cbb7-45eb-98dd-266eddcdf91c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.030398 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:55.035593 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.036515 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.036869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.037149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.048393 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:55.056821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:55.057738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:55.058765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 288/586] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:55.065916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:55.170134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b19cc-b528-4760-827e-8d90c466e881 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.205034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.205659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.205972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.206252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.207015 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:55.207327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:55.208811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:55.217652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 299/587] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:44:55.223120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:55.324121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4adb-9094-4f0f-94b5-dbcbf3a76488 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.357397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.358279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.358562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.358867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.369570 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:55.371053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:55.388329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:55.389286 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:55.390224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:55.390224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:55.390224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:55.390224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:55.394252 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 289/588] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:55.399054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:55.435724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:55.510248 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff54a8-3e99-475a-afdf-e35adaf4fa4e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.545245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.545934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.546216 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.546490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.547216 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:55.547519 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:55.548901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:55.564785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 300/589] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:55.566901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:55.613365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:55.668880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9121-945f-43c9-97ae-b0aa702c066b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.702070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.702869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.703152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.703430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.711543 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:55.713017 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:55.727233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:55.728173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:44:55.729187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:55.733087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 290/590] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:55.734496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:55.838229 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:55.842130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0672-e574-4202-9beb-a07181e63419 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:55.878672 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:55.879326 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:55.879543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:55.879901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:55.881026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:55.881400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:55.882893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:55.901299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 301/591] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:55.907134 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.014915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab8377-ae3d-4133-a4fd-c7c43d0b1e89 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.017574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.053317 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.054060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.054347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.054629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.124159 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:56.125693 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92c65-3aab-4d42-8732-a4834d03d57b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:56.232779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 291/592] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:56.238327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.310044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf71b-d698-43c8-bad3-fcc3dfe09e96 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.310697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf71b-d698-43c8-bad3-fcc3dfe09e96 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.311250 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf71b-d698-43c8-bad3-fcc3dfe09e96 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.313146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 292/593] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:44:56.323524 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.324119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.324600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.342539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:56.343867 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388486-7203-4a4d-a050-3202ce1f6af6 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.344302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:56.347855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.379339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.380226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.380576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.380819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.393797 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:56.399256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:56.422756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:56.423727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 302/594] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:56.424640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.431890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.477887 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 293/595] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:56.497233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.555300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c869ea-ebc6-49b4-94df-1e673b05dfb1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.591379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.592460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.592745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.593018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.594167 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:56.594484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:56.596177 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a29bc4-d93d-4f11-8e60-fd6511c02ea3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:56.609979 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 303/596] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:56.611293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68170b-b469-4eca-941f-dd1b3e28d693 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.611586 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68170b-b469-4eca-941f-dd1b3e28d693 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.611864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68170b-b469-4eca-941f-dd1b3e28d693 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.613280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 304/597] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:56.619008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68170b-b469-4eca-941f-dd1b3e28d693 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.621272 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac69c-da7d-410d-af0b-52390c169085 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.655505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.656338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.656595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.656893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.658870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.669498 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-4ea1b7e6-0efb-4462-95ab-18da1c670226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:56.677456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:56.678697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:56.679544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 294/598] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:56.680711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.680711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.680983 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.691606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.700051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:56.701455 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:56.743306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68170b-b469-4eca-941f-dd1b3e28d693 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.781341 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.782051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.790062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.790294 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 295/599] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:56.790394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.790481 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.798140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:56.799760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:56.821151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:56.822159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:56.823061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:56.828629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 305/600] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:56.828629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.903161 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f9930-2046-4638-8968-9413d4c1abe8 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.928861 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.938914 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dae3-3ee5-47b3-8a19-1130e7f48a53 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:56.940654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.941315 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.941592 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.941888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:56.942756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] RBAC: Adding query filter params (name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:56.943046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:56.944663 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:56.954153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 296/601] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:56.954767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:56.967182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:56.985540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:56.987003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:56.987303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:56.987576 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.002996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:57.013013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:57.014345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:57.015183 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:57.016316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 306/602] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:57.016316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.073959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c69f-81db-4735-9fee-cd94ea90c08c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.114041 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.114743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.115024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.115300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.116092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:57.116397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.117826 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.137585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 297/603] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:57.137585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.148436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347fbb-a6b8-45cc-8323-e979171b68ca None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.183272 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.185063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.185934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.186222 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.186501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.197700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.199200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-4e9ae7a9-bbcc-4cf3-a339-25fd09d3b8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:57.215705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:57.216577 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:57.217454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:57.217454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:57.217454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:57.217454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:57.217454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 307/604] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:57.218422 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a5ea-0b9b-4086-a18f-8d27371b9448 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.218706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a5ea-0b9b-4086-a18f-8d27371b9448 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.218980 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a5ea-0b9b-4086-a18f-8d27371b9448 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.220359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 308/605] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:57.220929 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44a5ea-0b9b-4086-a18f-8d27371b9448 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.242340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7abed0-8feb-4e42-aa37-8d6cf5bbbe25 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.253151 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.276643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.277314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.277597 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.277889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.278671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] RBAC: Adding query filter params (name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:57.279337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.280728 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.289707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 298/606] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:57.290569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.331366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44a5ea-0b9b-4086-a18f-8d27371b9448 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.364883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.365536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.365835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.366127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.366956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=580e48715b944a32a3b1218de325b996) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:57.367267 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.368698 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae799a-bccd-43ad-9321-711be86f2606 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.374439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 309/607] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/role_assignments?user.id=580e48715b944a32a3b1218de325b996&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:57.375598 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.375883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.376160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.398384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:57.399935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:57.423884 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72f1d-2661-443f-badf-54c70c4bd00d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.435628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.468125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.468807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.469090 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.469485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.470361 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:57.470676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.472112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.480531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 310/608] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:57.486792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 299/609] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:57.487885 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.493161 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.525763 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.611021 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918a03-b77e-4e11-80f9-be16e16cb165 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.614071 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198cf39-f991-4f9e-8d0d-d47fc2d236ff None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.650801 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.651616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.651901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.652267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.652616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.653417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.653720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.654356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.662693 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.664416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.666075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.668176 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:57.680022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:57.681198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 21:44:57.682407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:57.684702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 300/610] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:44:57.685627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:57.685951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:57.686789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:57.687764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:57.687764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:57.687764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:57.687764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:57.687764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 311/611] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:57.690563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.717845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.774020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.797563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61860b-7169-4cec-a8a5-004b9d9f2a72 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.797942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d637e-f024-40e6-af2d-31fab549f4c6 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.833348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.833726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:57.834055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.834226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:57.834322 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.834488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:57.834580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.834743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:57.835432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:57.835741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:57.837198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:57.845563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:44:57.860249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:57.861291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:44:57.862200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:57.862842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 312/612] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:57.862842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.862979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 301/613] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:57.862979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:57.956902 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:57.971511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cdc6f-c1fd-4fc6-8391-e555b2d76f24 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:57.984631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5215b5-e4fa-44fc-baf5-2dbb7bbbd9c8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.007292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.007738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.008022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.008297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.022057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.022736 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.023121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.023408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.024145 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:58.024456 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.025836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.028854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.039924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 313/614] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:58.040840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.086206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.087678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.142897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b0b9-59aa-43f5-8cff-37d19947193a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.177150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.177831 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.178254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.178545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.178765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.179300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:58.179608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.181149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.189815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 314/615] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:58.190565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.198415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 302/616] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:58.199479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.255384 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.303909 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb5a1-30c0-427a-a629-0cd368e37511 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.305339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd57a3-cb47-4c4c-8fce-ba17694976aa None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.341839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.342865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.343141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.343472 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.344633 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.345552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.345840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.346147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.354355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.354538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.355822 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.355925 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:58.370404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:58.371376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:58.372347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 315/617] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:58.372926 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:58.374977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:58.375842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 303/618] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:58.381957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.433646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.491089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522187-844f-4089-acd4-9697b15d7f1d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.497962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20626eb-d4a7-4cb3-8ccd-428e91d1d4ce None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.509960 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.529662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.530701 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.530989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.531263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.535365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.536047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.536432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.536733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.537737 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:58.538452 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.539519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.542801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.544124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.558882 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 304/619] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:58.560032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:58.563517 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:58.564496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:58.565385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:58.565385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:58.565385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:58.565385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:58.565385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 316/620] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:58.566278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.670889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.674369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04fcd2-6568-4778-a980-38084868c42e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.676747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d9b6f-66a3-4cea-91f9-4e0fe549446a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.711965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.712627 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.712974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.713315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.713653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.714444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.714756 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.715098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.715892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:58.716344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.717914 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.730557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 305/621] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:58.735525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.763763 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.795369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.796928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.844519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0271cea-141e-4757-9e8b-e87eae8a4946 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:58.885303 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:58.886004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:58.886298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:58.886563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:58.887283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:58.887591 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:58.888959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:58.905697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 306/622] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:58.905697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.906406 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 317/623] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:58.907359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:58.925887 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:58.978558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.011250 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f40e-d9c8-4022-aa71-ef4a07bdb0e3 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.012381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5864-d24b-4e61-91de-879f4762eae5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.047965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.048772 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.049054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.049327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.049584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.050412 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.050698 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.050975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.056757 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.058247 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.059100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.061320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:44:59.073087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:59.074266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 307/624] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:59.075440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:59.080983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:59.082051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:59.083199 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:59.085433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 318/625] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:59.086865 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.155785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.179594 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b97f-a9be-4729-8ff0-5594e374a445 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.199676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d2e5-6b9f-435d-8637-039123aeef0e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.216388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.217205 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.217489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.218004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.228535 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.229774 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.230046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.236385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.237059 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.237341 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.237616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.238504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:59.238812 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.240272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:44:59.249714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:59.250746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:59.251859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:44:59.251859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:44:59.251859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:44:59.251859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:44:59.255618 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 308/626] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:59.256536 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.261037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 319/627] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:59.261814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.373546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd048dc8-5864-4ddc-a162-f2cf57700618 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.374615 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851142ff-0177-472f-87d4-6c9a2cc2d95d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.403694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.412305 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.412992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.413276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.413556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.414389 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:59.414699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.416159 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.422558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.423442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.423903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.424353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.425278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:59.425780 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.427547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.428306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 309/628] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:59.429167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.444521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 320/629] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:59.445670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.499509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.545190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4174-ad8e-46a9-bb72-658aaa88888b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.561972 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d246804-feb0-49af-b479-760d123cd115 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.585350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.586045 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.586333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.586614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.599987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.600932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.601393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.601924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.602939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=d66fa72ed4554daaa34a0fe6f5d6f8ca) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:44:59.603398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.605062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.611186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 321/630] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/role_assignments?user.id=d66fa72ed4554daaa34a0fe6f5d6f8ca&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:44:59.612339 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.667461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.682470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.684922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194820a9-8caa-46d5-af4f-80a3fd95ef75 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.738228 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67320-fafa-4854-aa38-ede9b12273b2 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.754118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.782847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.783847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.784215 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.784574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.793014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.794686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:44:59.801126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 310/631] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:44:59.801126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5298e0-affd-4abe-8432-d8978d8b87dd None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.801126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5298e0-affd-4abe-8432-d8978d8b87dd None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.801126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5298e0-affd-4abe-8432-d8978d8b87dd None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.803572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 311/632] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:44:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:44:59.804507 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5298e0-affd-4abe-8432-d8978d8b87dd None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-216305fc-10e7-467a-bb9a-45a84f764b62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:44:59.817641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:44:59.819185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:44:59.820129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 322/633] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:44:59.820695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.820783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.821023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.840769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:44:59.841347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:44:59.918687 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 323/634] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:44:59.919588 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:44:59.923157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:44:59.938239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5298e0-affd-4abe-8432-d8978d8b87dd None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:44:59.978755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:44:59.979565 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:44:59.979849 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:44:59.980122 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:44:59.992075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:44:59.993557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:00.012213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:00.013304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:00.014262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:00.014262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:00.014262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:00.014262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:00.014262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 312/635] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:00.014670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.036257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b807e-64ff-420b-b70f-cc744900010d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.037806 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.073439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.074144 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.074854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.075137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.075936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.076249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.077700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.090673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 324/636] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:00.091499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.129611 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7667-0d91-496f-9f6a-8d0a3817d7d2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.164526 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.165409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.165606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.165907 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.176323 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:45:00.184040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:00.185894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 313/637] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:00.186872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.188934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.206900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314e674-b689-4614-bcbd-a02ee45e4b2d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.242362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.243124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.243411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.243687 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.244409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.244715 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.246127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.259930 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 325/638] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:00.264993 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.290437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.295556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618df5-8e3d-4da0-a0cb-82c666dd0eae None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.328535 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.329314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.329584 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.329851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.330707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=c0e23da86db744f88719c5511226d9a7) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.331025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.332457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.340831 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 314/639] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/role_assignments?user.id=c0e23da86db744f88719c5511226d9a7&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:00.341980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.406696 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bd6a4-1147-4a0c-8041-33603a704884 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.448869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.456498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.458174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.462404 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.462813 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.463748 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.464166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.466458 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.479003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 326/640] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:00.484273 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.496955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2efa-0b7d-4b7d-b142-acaa05fdfe49 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.533440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.534151 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.534432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.534706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.542316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.543848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:45:00.559380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:00.560839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:00.561853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 315/641] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:00.568710 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.588799 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.610888 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7be201-c638-4a8f-9405-bcb51b609d73 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.652148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.653575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.655096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.655581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.671011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.673300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.689935 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33f389-5d5d-4dcf-a668-729d2a080c42 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:00.696618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:00.697507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:00.698520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:00.698520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:00.698520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:00.698520 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:00.704143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 327/642] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:00.705770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.719556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.729352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.730079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.730361 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.730721 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.731566 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.731871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.733379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.751766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 316/643] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:00.754165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.828719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42cf93-dbed-4ce6-8cab-a64a98f9cfd4 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.864309 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.865049 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.865333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.865728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.866524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.866837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.868638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.871944 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:00.885301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 328/644] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:00.890448 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:00.894851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c6e8-a272-4770-8bb2-a0cddc8dcde9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:00.946551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:00.948077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:00.948504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:00.948922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:00.950497 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=661831a6f5214520a43b84201a4588db) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:00.951496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:00.953639 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:00.962816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 317/645] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/role_assignments?user.id=661831a6f5214520a43b84201a4588db&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:01.018408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae514-f1d8-4bb2-82eb-be406b98a593 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:01.059069 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:01.059893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:01.060177 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:01.060452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:01.069596 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:01.071245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:45:01.087503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:01.088678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:01.089924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 329/646] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:45:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:01.094405 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:01.150569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:01.207844 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e907-7463-41f0-badb-1c4443ddc8e5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:01.243071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:01.243748 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:01.244034 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:01.244314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:01.245205 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:01.245480 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:01.246957 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:01.265304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 318/647] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:45:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:01.270688 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:01.336900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:01.382759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385366e-644e-40e7-84f6-933582b4abb3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:01.417849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:01.418536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:01.418819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:01.419093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:01.488263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:01.490061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:01.546453 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:01.592186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 21:45:01.597644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:01.701591 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4542bd-0b44-41b1-a348-6dad8a5b0122 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:01.711828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:01.743025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:01.744194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:01.744725 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:01.745196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:01.756319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:01.758053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:01.776340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:01.777301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:01.778242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:01.778242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:01.778242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:01.778242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:01.780853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 319/649] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:01.786829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:01.891090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07f5b-af36-461a-a2c2-2456db8894ae None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:01.932754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:01.933426 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:01.933711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:01.934023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:01.934756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:01.935067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:01.936446 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d154fae-4517-4275-8a7a-ec4db76a6541 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:01.949076 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 331/650] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:01.954678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.037546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2111-75ef-4cf8-aaad-195de2dd1ce7 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.037941 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2111-75ef-4cf8-aaad-195de2dd1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.038161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2111-75ef-4cf8-aaad-195de2dd1ce7 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.040784 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 332/651] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:02.044875 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.045166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.045451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.061612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238ec4-bea3-4204-9f1f-9bd9a0c39919 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.062626 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:02.064005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:02.075606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:02.101153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.102432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.102814 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.103185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.110999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.112549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:45:02.127345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:02.128477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:02.129638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:02.131683 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 320/652] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:02.137379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.147709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 333/653] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:45:02.164602 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:02.170381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.256194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429995ff-42b1-418d-adb0-d56d4a89484c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.293897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a72be-7a48-40ec-b78d-c8e78402eccd None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.302525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.303358 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.303759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.304136 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.305495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:02.305928 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.308149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.330367 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 321/654] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:02.331488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.332503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.333542 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.334036 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.334573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] PATH_INFO: `/v3/services/image` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.335534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.337510 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:02.352287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:02.353417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:02.354310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:02.356792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 334/655] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:02.362741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.380432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:02.431486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:02.459064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4771-112e-4b0d-9ecd-996e114b239f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.499722 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdb386-ed37-4a95-bdda-1008de280b51 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.501691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.503599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.503599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.503599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.503845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=580e48715b944a32a3b1218de325b996) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:02.504043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.505681 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.513973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 322/656] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/role_assignments?user.id=580e48715b944a32a3b1218de325b996&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:02.547239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.548273 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.548734 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.549180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.550118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] RBAC: Adding query filter params (name=image) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:02.550605 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.552492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8b15-ed8c-45e5-874d-35515dab21da None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.558058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 335/657] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:02.567018 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:02.686154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267ff-a81a-49a0-bc3c-6b9753af314c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:02.724750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:02.725711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.726171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.726661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.727584 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:02.728029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:02.729558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290601d-746c-4b7a-8e4f-b95e6a8417d6 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:02.736548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 323/658] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:02.797106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818680f7-2271-4d77-a743-047ceb1f4c8c None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.797628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818680f7-2271-4d77-a743-047ceb1f4c8c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.798088 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818680f7-2271-4d77-a743-047ceb1f4c8c None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.799687 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 336/659] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:02.805950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:02.806482 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:02.806900 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:02.825785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:02.827498 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:02.829984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:02.906384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 324/660] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:45:02.933149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818680f7-2271-4d77-a743-047ceb1f4c8c None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.020245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:03.049294 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818680f7-2271-4d77-a743-047ceb1f4c8c None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.085132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.085984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.086273 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.086550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.087210 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.088782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:03.101505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:03.102507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.103353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 337/661] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Jul 15 21:45:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:03.112683 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.214864 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf794-a3a7-42b8-b803-3b071d94a22d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.256238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.257325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.257829 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.258323 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.259231 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:03.259729 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.261309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894b54-fed7-41bf-a4e3-2898e4715654 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:03.266751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 325/662] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:03.272795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.374843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae038a-5585-4e84-9470-6fd881f88420 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.381558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8ca7-5309-46c8-850b-484451656906 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.381839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8ca7-5309-46c8-850b-484451656906 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.382140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8ca7-5309-46c8-850b-484451656906 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.383916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 326/663] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:03.388937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.389221 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.389496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.394686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:03.408719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:03.409949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:03.416467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.417266 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.417647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.418543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.419257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:03.419562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.421387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:03.429982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 338/664] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:03.491450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 327/665] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:45:03.515441 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.519449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:03.632163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf590-ffdf-4530-acf3-1c79abe0b747 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.669143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.669983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.670269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.670546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.671311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.672799 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:03.685497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:03.686529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:03.687378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 339/666] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:03 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:03.692996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.799976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaa48-3fd3-4a55-9e3c-79fa7c4361f8 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.830388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:03.836801 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.837485 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.837770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.838081 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.838858 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] RBAC: Adding query filter params (name=network) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:03.839166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.840601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5324e1-9857-4686-aea3-957f24935f08 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:03.845572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 328/667] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:03.851096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:03.919342 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:03.956302 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02600-289a-4fb1-bd3c-d87da8c567b9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:03.991926 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:03.993026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:03.993533 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:03.994065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:03.994979 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] RBAC: Adding query filter params (type=network) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:03.995490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:03.997063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961b3f-5078-498b-ac58-64de21fd5a56 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:04.004000 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 340/668] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:04.841513 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280b5a-ff56-464b-8096-5638b69aa8f3 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:04.842080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280b5a-ff56-464b-8096-5638b69aa8f3 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:04.842156 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280b5a-ff56-464b-8096-5638b69aa8f3 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:04.843738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 329/669] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:04.849225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:04.849624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:04.849786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:04.866938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:04.868118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:04.937939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 341/670] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:45:04.961567 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280b5a-ff56-464b-8096-5638b69aa8f3 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.071371 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280b5a-ff56-464b-8096-5638b69aa8f3 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.106428 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.107150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.107430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.107703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.118351 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-79b1c33d-1e8d-45cd-9d14-677a35c8bc67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:45:05.125833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:05.126774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:05.127617 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 330/671] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:05.134070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.179099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b98f5-5680-4ee5-b704-9e1778c2fd8e None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.179434 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b98f5-5680-4ee5-b704-9e1778c2fd8e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.179643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b98f5-5680-4ee5-b704-9e1778c2fd8e None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.181417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 331/672] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:05.186745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.187136 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.187510 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.199301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:05.210000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:05.211548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:05.245349 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b59d-f239-4f71-b0d3-e659d7ea3818 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.267166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:05.293447 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.294317 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.294429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.295154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.296707 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:05.296707 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:05.297239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:05.297463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 332/673] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 21:45:05.318051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 342/674] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:05.325996 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.326861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.431263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739831c-e931-47d5-a1bd-546a3e2269b1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.447856 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f220e-0f39-44a2-9efb-141007e692fb None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.457999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:05.474133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.475397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.475891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.476602 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.477948 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:05.480019 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:05.490826 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.491772 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.492126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.492668 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.502146 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 343/675] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:05 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:05.513265 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:05.514828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:05.538583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:05.539547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:05.540926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:05.540926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:05.540926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:05.540926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:05.540926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 333/676] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:05.546261 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.678121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189916-c182-46b5-82ab-04cb6bd7050e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.720584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.721307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.721602 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.721911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.722685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:05.722979 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:05.725032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30238fe2-ce18-45ab-812f-f8366dd60b40 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:05.738309 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 344/677] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:05.744150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.792398 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:05.855723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d95b0-1f29-4d85-8a64-03217f07f480 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:05.858861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f0f9-cbc2-46a0-a967-2a704c908a1b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.859316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f0f9-cbc2-46a0-a967-2a704c908a1b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.859511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f0f9-cbc2-46a0-a967-2a704c908a1b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.861608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 345/678] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:05.871612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.872643 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.873550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.893708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:05.894538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:05.894820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:05.895095 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:05.897457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:05.899479 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:05.903407 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:05.905058 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:45:05.924813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:05.926009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:05.927267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 334/679] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:45:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:05.932004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:05.937127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:05.999473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 346/680] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:05 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:45:06.024210 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.053606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:06.058056 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea919567-99a3-45ff-8359-b3ca90791d4c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.093614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.094715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.095192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.095660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.096687 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:06.097206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.098944 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.117533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 335/681] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:45:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:06.126671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.141266 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0fbf2-9013-4a4a-b179-a938ac81b9f9 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.180829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.182562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.183099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.183607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.184611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.187329 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c225b4-ee45-4be7-9510-bee356976279 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.210255 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 347/682] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:06 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:45:06.252043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423702-592a-4ef6-ab9a-8d11bbedc79e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.309273 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.310181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.310466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.310739 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.323316 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.324911 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:06.345376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:06.346406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:06.347454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:06.347454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:06.347454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:06.347454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:06.347454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 336/683] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:06.353189 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600934b5-f3df-46a1-ba86-d161aa016dd0 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.353362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600934b5-f3df-46a1-ba86-d161aa016dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.353562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600934b5-f3df-46a1-ba86-d161aa016dd0 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.354131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.355197 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 348/684] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:06.358254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:06.360857 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.361144 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.361425 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.382115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:06.383455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:06.414793 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:06.481050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a33c-9a01-4bec-94ca-827396f1f8d4 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.484353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 349/685] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:06 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 21:45:06.509782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.517215 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.517913 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.518605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.518735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.519421 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:06.519731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.521292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.535652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 337/686] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:06.542846 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.631548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899eeed-c1b7-4393-ae33-597dd5844da7 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.672133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.673082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.673546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.674044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.674939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.676514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.698830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 350/687] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:06 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:45:06.754044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:06.798519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d05ad-788c-4bcb-a73a-dc338e257212 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:06.845686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:06.846552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:06.846830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:06.847108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:06.855784 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:06.857261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:45:06.873029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:06.874086 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:06.874999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 338/688] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:06.882106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:06.905100 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:06.992668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db948c-762a-4b7c-a2e1-7e10e9b102ab None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:07.031067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:07.032071 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:07.032571 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:07.033043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:07.034093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:07.034599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:07.036305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43679-7628-469d-bd29-42e8a45cfbfc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:07.052721 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 351/689] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:07.056413 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:07.163172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d1435-7823-47fb-a82e-7c5f1b81d0d5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:07.183540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:07.198184 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:07.199074 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:07.199353 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:07.199628 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/580e48715b944a32a3b1218de325b996/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:07.201586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=580e48715b944a32a3b1218de325b996, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:07.203131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55678b-a6e8-4d97-8b01-f1b99bb26a12 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:07.221685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 339/690] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:45:07 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/580e48715b944a32a3b1218de325b996/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:45:07.973548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d10a4-2fa8-4c67-8a09-0884e14e7f95 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:07.974355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d10a4-2fa8-4c67-8a09-0884e14e7f95 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:07.974438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d10a4-2fa8-4c67-8a09-0884e14e7f95 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:07.976843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 352/691] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:07.985338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:07.985809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:07.986203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.009115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:08.010362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:08.097981 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 340/692] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:08.118660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d10a4-2fa8-4c67-8a09-0884e14e7f95 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.202142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:08.225191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d10a4-2fa8-4c67-8a09-0884e14e7f95 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.259597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:08.260395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.260679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.260955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.261609 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:08.263009 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:08.274977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:08.276018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:08.276881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 353/693] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:08.282675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.402774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd655e3-e129-43a4-8a18-d5c18a2e27e0 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.426268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:08.443788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:08.444491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.444785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.445064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.445796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] RBAC: Adding query filter params (name=image) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:08.446146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:08.447834 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:08.458290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 341/694] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:08.460411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.574290 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9616-5a72-447f-b456-e5c92cd045a1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.610485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:08.611468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.611961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.612417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.613306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] RBAC: Adding query filter params (type=image) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:08.613792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:08.616269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd33e5-8a60-4819-b174-ca22b1a7bb20 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:08.625988 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 354/695] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:08.628131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.674200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec824a-8059-42ba-bd29-6f48311aa6b8 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.674835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec824a-8059-42ba-bd29-6f48311aa6b8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.675295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec824a-8059-42ba-bd29-6f48311aa6b8 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.680203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 355/696] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:08.684400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.684794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.685174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.702243 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:08.704486 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:08.706213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:08.751921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843f1d-3c51-4679-8fcf-b0d6519abe65 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.787692 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:08.788360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.788644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.788921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.789709 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] RBAC: Adding query filter params (interface=public, service_id=92db8449244c4b448457d87caef7e530, region_id=RegionOne) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:08.790059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:08.791430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:08.799525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 342/698] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/endpoints?service_id=92db8449244c4b448457d87caef7e530&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:08.799755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 356/698] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:08.806445 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.825396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:08.851886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:08.924768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcc53a-c04f-4b47-9349-0da95dc714be None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.951527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65219-0634-48ae-a3ee-2d959ca7ca9d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:08.974294 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:08.975163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:08.975541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:08.975912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:08.977260 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:08.979145 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:08.990340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 343/699] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:45:09.000290 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.001918 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.002475 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.002932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.003850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.006504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.010306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7affe090-174f-4da2-9232-e8a68263807c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:09.022747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:09.023776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:09.024650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.032563 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 357/700] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Jul 15 21:45:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:09.034314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.106861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffb8d-3363-4098-adbc-cd2e0a2b9a1c None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.107546 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffb8d-3363-4098-adbc-cd2e0a2b9a1c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.108045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffb8d-3363-4098-adbc-cd2e0a2b9a1c None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.110171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 358/701] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:09.120087 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.120982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.121494 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.147164 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:09.149607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:09.158055 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d6824-ad2f-486d-b56a-fdd91f0d0e04 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.159918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.204116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.204785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.205063 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.205333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.206075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:09.206381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.207740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.213072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 344/702] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:09.219134 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.257966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 359/703] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:09.280998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.337173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494f0c-65a1-4556-8933-b27ce1bb96aa None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.373574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.374206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.374484 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.374762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.375581 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:09.375886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.377245 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.383234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 345/704] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:09.390566 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.400986 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d147e-e225-4012-aaa8-d72fe4dbe688 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.426929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.444664 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.452251 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.453790 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.454954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.455468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.456638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.459681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:09.478505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:09.479668 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:09.480539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:09.486270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 360/705] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:09.488271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.527000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf58a-c10f-4f21-a145-b100a66711b6 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.574959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.575858 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.576240 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.576616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.578030 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] RBAC: Adding query filter params (interface=public, service_id=840c551667824564afbf6db2b164db1e, region_id=RegionOne) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:09.578459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.579952 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.587816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 346/706] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/endpoints?service_id=840c551667824564afbf6db2b164db1e&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:09.593070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.616409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022e34-9e9b-4595-a1c0-1b8f5e8f13b8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.652981 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.653571 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.654251 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.654529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.655245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] RBAC: Adding query filter params (name=network) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:09.655556 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.656940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18768fe9-8438-42eb-b4b0-50924477cb0f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.666794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 361/707] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:09.666794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaf7-d399-4a31-a77d-8c8774a6c907 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.666794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaf7-d399-4a31-a77d-8c8774a6c907 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.666794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaf7-d399-4a31-a77d-8c8774a6c907 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.666794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 362/708] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:09.667667 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eaf7-d399-4a31-a77d-8c8774a6c907 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.709218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.717975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf268-18ad-4186-9503-4cb7b466816b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.733386 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:09.751599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.752267 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.752896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.752896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.754912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f660e8-c78c-43a2-ad0c-e1dba2f2a873 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.761153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 347/709] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:45:09.762298 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.763268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.763549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.787383 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:09.788615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:09.801447 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eaf7-d399-4a31-a77d-8c8774a6c907 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:09.853491 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:09.854822 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:09.855319 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:09.855997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:09.857436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] RBAC: Adding query filter params (type=network) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:09.858217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:09.860154 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:09.865476 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 348/710] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:09.867735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 363/711] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:09.873504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.891548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:09.996089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:10.013711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ded2e7-17a5-44cf-9e44-f2b7064e38c6 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.053711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.054712 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.055154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.055572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.056514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] RBAC: Adding query filter params (interface=public, service_id=a9d65798469c49fbbdd9667843b4638e, region_id=RegionOne) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:10.056974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.058608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.065142 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 349/712] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/endpoints?service_id=a9d65798469c49fbbdd9667843b4638e&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:10.071107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:10.130482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9cb6-41c9-4783-b751-ff869e9f771d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.155264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:10.171840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.173536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.173993 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.174662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.182720 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3b2-335b-48eb-a005-1acd72457220 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.191124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:45:10.202081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:10.203230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:45:10.204282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:10.207311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 364/713] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:10.213263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:10.229110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.230048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.230397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.230735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.231482 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.233072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.239619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 350/714] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:45:10.333018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879a6a-b4e9-496f-90dd-b98a6b9ea9d3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.373701 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.374666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.375103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.375554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.376456 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:10.376970 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.378735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.391482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 365/715] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:10.398264 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:10.419390 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:10.512471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaeeab9-f8e1-460d-b78f-10a6e11af2ba None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.547612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.548584 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.548959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.549327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.560142 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.561755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:10.579475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:10.580601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:10.581551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:10.581551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:10.581551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:10.581551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:10.582131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 351/716] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:10.588964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:10.635903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:10.691217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d807-ad63-49e8-b7fa-15ede002027b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.725845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.726539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.726817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.727087 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.727812 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:10.728115 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.729492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.741481 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 366/717] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:10.747009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:10.814769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:10.851236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6da9-7db1-4b9a-8570-4d7c965e73f4 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:10.891167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:10.892367 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:10.892843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:10.893306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:10.901258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:10.902958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:45:10.918214 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:10.919235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 21:45:10.920178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:10.922805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 352/718] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:10.928946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.031713 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9f9f-3688-4c0f-b71a-8efedab2847f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.034996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.069357 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.070435 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.070966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.071507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.072541 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:11.073045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.074681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14a16a-80ae-4256-bfc7-2f35c304c355 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.093755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 367/719] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Jul 15 21:45:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:11.099817 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.206898 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd1666-5475-4e0e-85cd-5b4346d9872f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.234360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.242855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.243793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.244271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.244739 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.324008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.325461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.430626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 353/720] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 21:45:11.434678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4c0a-828b-480d-b222-bdf7532d604e None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.435511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4c0a-828b-480d-b222-bdf7532d604e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.435980 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4c0a-828b-480d-b222-bdf7532d604e None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.437731 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 368/721] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:11.438945 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.442827 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.443106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.443382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.460253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:11.461359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:11.471734 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.531839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 369/722] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:11.555776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0abdf-a8c8-4142-94ed-489a3b690322 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.555982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.600544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.601352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.601632 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.601938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.613132 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.614675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:11.634072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:11.635024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:11.635916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:11.635916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:11.635916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:11.635916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:11.640157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 354/723] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:11.641031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.664647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.675499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526077-274f-49e3-8537-32a2b8d78817 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.714499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.715217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.715501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.715781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] PATH_INFO: `/v3/services/image` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.716544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.718112 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:11.730394 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:11.731409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 21:45:11.732235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:11.736544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 370/724] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:11.737768 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.744077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.766649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd756-cb66-4449-ad7c-3f0986b94c48 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.805877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.806576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.806861 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.807140 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.808065 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:11.808293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.809582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.826210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 355/725] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:11.827820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.854488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d3c6-af6b-4393-85fb-253f7d6c91fa None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.890487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.891726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.892522 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.893281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.894281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] RBAC: Adding query filter params (name=image) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:11.894782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.896543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.903709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 371/726] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:11.911863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:11.937593 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f495dc-5c61-4df9-8e41-10e19634fef9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:11.940793 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:11.976866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:11.977587 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:11.977895 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:11.978172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:11.986531 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:11.988112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:11.991764 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:45:12.007129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:12.008080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:12.008942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:12.013288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 356/727] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:12.014170 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.038242 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad7ad-3f82-4fdf-92e3-5dc716a49da2 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.085044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.086395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.086681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.087572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.088306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] RBAC: Adding query filter params (type=image) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:12.088615 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.090147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.100646 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 372/728] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:12.101524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.139730 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3161c2-e69e-4e1b-8705-4961dd43d5a7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.179802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.180632 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.180920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.181193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.182108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:12.182805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.184023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3def580-42fd-4605-9d71-bddcb2a59c1b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.198575 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 357/729] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:12.200230 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0130c-bee8-41f3-8768-44100187ff5f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.200787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0130c-bee8-41f3-8768-44100187ff5f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.201275 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0130c-bee8-41f3-8768-44100187ff5f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.202949 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 358/730] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:12.207234 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.207985 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0130c-bee8-41f3-8768-44100187ff5f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.220893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9df58-c73d-4adb-a004-a65340e9ce43 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.255364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.255946 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.256231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.256501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.257258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.258660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37d0c-4794-48c6-bcca-6828d4c59581 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.274735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.282153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 373/731] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:12.283661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.284639 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.303480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:12.305142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:12.340027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0130c-bee8-41f3-8768-44100187ff5f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.389900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 374/732] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:12 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:12.394453 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.395565 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.396077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.396544 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.397606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=580e48715b944a32a3b1218de325b996) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:12.398152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.399906 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.412607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 359/733] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/role_assignments?user.id=580e48715b944a32a3b1218de325b996&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:12.423179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.510513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.556765 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe6da3-b981-4589-b4e1-73a56c34f1a9 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.597176 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.598072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.598354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.598681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.599379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.600923 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-6ce73a55-e281-4d96-9757-bff8071be4c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:12.614330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:12.615314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:12.616170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 375/734] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:12.623167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.668200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3661-1f30-43ae-8740-e4fb22edbbff None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.668482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3661-1f30-43ae-8740-e4fb22edbbff None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.668759 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3661-1f30-43ae-8740-e4fb22edbbff None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.673312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 376/735] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:12.675419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.675693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.675971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.695739 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:12.696936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:12.750747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8eec-58cc-48a3-9cc5-54587efd1472 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.772581 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.788198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 377/736] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:12 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:12.789745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.790700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.791180 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.791674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.792670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:12.793255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.794916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.800444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 360/737] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:12.806547 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.811031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.878957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:12.924481 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da97cdc-256f-473c-9ebd-6abd49f0f578 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.929608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e33fa-710b-4362-8b79-508054903530 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:12.961605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.962604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.963031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.963400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] PATH_INFO: `/v3/services/network` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.964349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.965800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.973791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:12.974801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:12.975254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:12.975708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:12.976562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:12.977011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:12.978534 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:12.980409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:12.981572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 21:45:12.982733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:12.985462 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 361/738] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:12.990802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:12.998193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 378/739] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:12.999624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:13.047124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:13.103025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d3fe-25f3-4374-9b9e-3c3a9838782b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:13.127663 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db76cf-e8ed-4bc0-948d-7c8610d2b390 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:13.137978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:13.138665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:13.139175 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:13.139285 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:13.139930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] RBAC: Adding query filter params (name=network) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:13.140496 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:13.141702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:13.149908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 362/740] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:13.152741 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:13.165572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:13.176082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:13.176848 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:13.177120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:13.177406 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:13.178678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:13.180351 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:13.209815 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 379/741] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:45:13.287527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2d28f-e325-462b-9695-6168034bbf7e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:13.311814 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:13.340208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:13.340937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:13.341223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:13.341499 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:13.342240 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] RBAC: Adding query filter params (type=network) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:13.342545 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:13.343917 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da04c-f812-4d57-8bfa-8fd2423f8521 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:13.350002 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 363/742] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:13.363048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:13.478045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b4c6-9e3f-467b-b417-c7eefef97563 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:13.512807 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:13.514323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:13.514871 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:13.515338 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:13.516333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:13.518026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2b70f-8bb5-488c-b4aa-447e44ea1eaa None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:13.539514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 380/743] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:14.698450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b058b9-6f49-4faf-b9ec-8920b2d03814 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:14.699029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b058b9-6f49-4faf-b9ec-8920b2d03814 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:14.699029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b058b9-6f49-4faf-b9ec-8920b2d03814 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:14.700342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 364/744] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:14.705807 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:14.706246 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:14.706433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:14.723397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:14.724601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:14.760240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:14.800169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adfc9-1f88-449c-8be2-6b44236f7302 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:14.800501 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adfc9-1f88-449c-8be2-6b44236f7302 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:14.800762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adfc9-1f88-449c-8be2-6b44236f7302 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:14.802331 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 365/745] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:14.806010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 381/746] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:14.807417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:14.807781 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:14.808125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:14.825439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:14.826802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:14.827360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:14.895847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 366/747] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:14.919280 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:14.932123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e89d7d-b219-4589-be41-367885e495f8 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:14.969127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:14.970225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:14.970694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:14.971135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.007103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.020815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549315b-d976-48fd-a555-b3ed0ea1fa7e None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.022378 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.047321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.049182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.057399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.058256 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.058540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.058821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.059487 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.060850 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:15.073146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:15.074148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:15.075160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:15.079238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 367/748] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Jul 15 21:45:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:15.080146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.165431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 382/749] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:45:14 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 21:45:15.166620 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.183500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c21493-8eb4-469a-903c-82597d04e9f9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.221169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.222102 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.222555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.222985 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.223866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:15.224423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.225806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.230976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 368/750] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:15.236478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.236708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.272137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.277780 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471facba-fc57-4079-bc6e-74d21ed00fea None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.314611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.315416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.315697 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.315973 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.327123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.328581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.346192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a6c9-01f9-4201-9aaa-5ea0186a3a39 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:45:15.347170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:15.348025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:15.349400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:45:15.349400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:45:15.349400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:45:15.349400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:15.349400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 383/751] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:15.354616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.391897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789189bd-7419-45e5-8395-a99065977470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.392600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789189bd-7419-45e5-8395-a99065977470 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.392894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789189bd-7419-45e5-8395-a99065977470 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.393194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789189bd-7419-45e5-8395-a99065977470 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.393953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789189bd-7419-45e5-8395-a99065977470 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:15.394526 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789189bd-7419-45e5-8395-a99065977470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.396291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789189bd-7419-45e5-8395-a99065977470 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.406125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 369/752] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:15.480295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315d2f2-cab4-4aed-84b7-63f409505323 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.499555 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.518994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.519673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.519958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.520231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.521239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:15.521846 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.523224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.533475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f23-a884-4efc-acfb-823a8e8e9b82 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.533759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f23-a884-4efc-acfb-823a8e8e9b82 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.534068 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f23-a884-4efc-acfb-823a8e8e9b82 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.535605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 370/753] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:15.545940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 384/754] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:15.546172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.546172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.546172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.561582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:15.562903 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:15.647780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 371/755] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:15.672128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.785233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4ca1-a3a5-47cd-a4e6-d34a657d722e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.821899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.822960 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.823150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.825891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.825891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.825891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:15.837539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:15.838589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:15.839440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 385/756] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:15.844881 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:15.872793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:15.947786 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2a891-606d-4b53-9989-f776bb42feee None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:15.983865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:15.984555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:15.984826 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:15.985106 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:15.985837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:15.986179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:15.987551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ea8a3-08aa-4d6a-8ada-bf54ee557551 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:15.992500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 372/757] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:15.998398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:16.045307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:16.102509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717a4e-5ece-4ad2-84df-ae0eb14d64ec None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:16.136995 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:16.137654 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:16.137964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:16.138245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:16.138951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:16.139254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:16.140623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64be25-4f44-49b3-8218-a5a6df1f0686 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:16.145344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 386/758] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:17.749576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94fbb-95bd-4f8b-8b36-04ce79733dd8 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:17.750202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94fbb-95bd-4f8b-8b36-04ce79733dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:17.750202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94fbb-95bd-4f8b-8b36-04ce79733dd8 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:17.751519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 373/759] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:17.756870 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d1f-2060-4013-b456-2955bb946f52 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:17.757311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d1f-2060-4013-b456-2955bb946f52 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:17.757420 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d1f-2060-4013-b456-2955bb946f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:17.775515 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-071a8d1f-2060-4013-b456-2955bb946f52 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:17.776694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-071a8d1f-2060-4013-b456-2955bb946f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:17.849255 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 387/760] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:17 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:17.873308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94fbb-95bd-4f8b-8b36-04ce79733dd8 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:17.963825 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:17.978158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94fbb-95bd-4f8b-8b36-04ce79733dd8 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:18.014751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:18.015327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:18.015671 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:18.015947 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:18.016670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:18.018066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a13a7-02af-4a22-8641-77409d8886d1 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:18.033712 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 374/761] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:17 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:18.359308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8cc1-4bc0-43be-82bf-55739d7b8a19 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:18.359508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8cc1-4bc0-43be-82bf-55739d7b8a19 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:18.359780 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8cc1-4bc0-43be-82bf-55739d7b8a19 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:18.361326 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 388/762] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:18.366810 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15735d-732d-4bcd-883e-31b14dd70840 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:18.367101 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15735d-732d-4bcd-883e-31b14dd70840 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:18.367378 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15735d-732d-4bcd-883e-31b14dd70840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:18.385263 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5f15735d-732d-4bcd-883e-31b14dd70840 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:18.386443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5f15735d-732d-4bcd-883e-31b14dd70840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:18.468008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 375/763] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:18 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:18.491982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8cc1-4bc0-43be-82bf-55739d7b8a19 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:18.530468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:18.597429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8cc1-4bc0-43be-82bf-55739d7b8a19 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:18.632818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:18.633411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:18.633699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:18.634014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:18.634748 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:18.636136 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23111ce-f69d-458a-8122-9d0cb78ac311 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:18.651314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 389/764] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:18 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:20.276954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838b5b-48ae-447b-98f0-5a4860a8a10c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.277541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838b5b-48ae-447b-98f0-5a4860a8a10c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.277541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838b5b-48ae-447b-98f0-5a4860a8a10c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.279294 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 376/765] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:20.284769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.285156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.285352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.302942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:20.304109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:20.379359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 390/766] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:20.403405 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838b5b-48ae-447b-98f0-5a4860a8a10c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:20.482391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:20.510466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838b5b-48ae-447b-98f0-5a4860a8a10c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:20.545011 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:20.545741 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.546054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.546332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.546977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:20.548384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:20.560822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:20.561777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:20.562652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 377/767] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Jul 15 21:45:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:20.568369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:20.593725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:20.673239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef01b-bda6-46a4-945a-a2f05ea0893e None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:20.708281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:20.709023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.709307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.709565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.710311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:20.710618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:20.711998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:20.716943 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 391/768] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:20.722890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:20.834861 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072b2e-ae33-48b0-85f7-935361105d59 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:20.869916 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:20.870606 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.870888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.871166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.871878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:20.872189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:20.873548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1bb2-2372-41ff-ba82-b7a518680a35 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:20.878581 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 378/769] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:20.884835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:20.902609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd260fa-047b-41f1-9f0f-235b3414232d None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.902874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd260fa-047b-41f1-9f0f-235b3414232d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.903176 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd260fa-047b-41f1-9f0f-235b3414232d None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.905129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 379/770] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:20.909791 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:20.910121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:20.910395 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:20.915670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:20.927776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:20.928980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:20.975207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:20.992266 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70911-53c3-456b-8f58-c2db6ab7a93c None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:20.997750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 380/771] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:21.021114 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.027719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.028391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.028673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.029313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.030160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] RBAC: Adding query filter params (interface=public, service_id=46aa4e0209394dcfa593319b78cfee03, region_id=RegionOne) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:21.030473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.031852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.039527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 392/772] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:20 2022] GET /identity/v3/endpoints?service_id=46aa4e0209394dcfa593319b78cfee03&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:21.044999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.117847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5863e-6a20-41b5-906e-af260292bc1d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.141008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8896e6-53d7-4259-9c24-292bf09790cf None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.145787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:21.151350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.152151 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.152431 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.152702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.153356 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.155120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:21.166790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:21.167845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:21.168888 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 381/773] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:21.173908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.174040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.174712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.174994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.175269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.175952 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.177473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.183562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 393/774] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/services => generated 1498 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:45:21.282268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b80d5-b2cf-421b-a512-d24abe931401 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.318745 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.319437 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.319718 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.319997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.320714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:21.321019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.322456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.328009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 382/775] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:21.334158 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.351810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:21.446046 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b66ba-0bc4-44d4-967a-d0be459968d9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.480670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.481328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.481610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.481881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.482625 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:21.482933 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.484321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.489747 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 394/776] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:21.495804 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.558633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:21.601820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f8d26-36ee-46f6-bca5-e0d7db93a794 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.637146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.637804 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.638114 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.638397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.639189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] RBAC: Adding query filter params (interface=public, service_id=105f075f137e403bace12230fb50b946, region_id=RegionOne) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:21.639501 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.640942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a49fe-6b06-4c3b-8cd0-5d95f6de6509 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.646440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 383/777] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/endpoints?service_id=105f075f137e403bace12230fb50b946&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:21.652127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:21.744171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:21.766839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a370d-9184-4413-ac76-7cf370c5dce9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:21.802770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:21.803423 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:21.803706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:21.803976 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:21.804655 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:21.806072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4d2be-9cc2-4d52-8f65-f8f3ef90cb2c None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:21.812469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 395/778] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:21 2022] GET /identity/v3/services => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:45:23.484552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72520c-ec62-47cf-88f8-dea541d3b911 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:23.485124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72520c-ec62-47cf-88f8-dea541d3b911 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:23.485124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72520c-ec62-47cf-88f8-dea541d3b911 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:23.486563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 384/779] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:23.493055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:23.493545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:23.493652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:23.512083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:23.513276 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:23.586603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 396/780] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:23.610304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72520c-ec62-47cf-88f8-dea541d3b911 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:23.716310 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72520c-ec62-47cf-88f8-dea541d3b911 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:23.738994 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:23.751059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:23.751871 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:23.752149 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:23.752426 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:23.753077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:23.754495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:23.768698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:23.769703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:23.770807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 385/781] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Jul 15 21:45:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:23.776416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:23.854390 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:23.887515 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f72d0-4be9-4200-81ef-0ce1419f602f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:23.922982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:23.923647 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:23.923927 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:23.924203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:23.924906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:23.925211 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:23.926697 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0c1e-6faa-4d66-a35e-36d393cdef16 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:23.932039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 397/782] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:23.937896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:23.999928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84549-434b-4ac0-8601-095a5dd9b29a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.000171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84549-434b-4ac0-8601-095a5dd9b29a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.000484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84549-434b-4ac0-8601-095a5dd9b29a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.001871 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 398/783] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:24.007149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.007432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.007705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.024277 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:24.025455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:24.043338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a43f-4c34-4575-988f-d9bcad8707fd None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.076046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.076708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.076989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.077262 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.077999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:24.078293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.079655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.084414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 386/784] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Jul 15 21:45:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:24.092260 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:24.094538 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 399/785] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:24.118462 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:24.153026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:24.188771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:24.206416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1050-433f-411f-909e-08bbb83eb2f7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.224383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72de4a-4d39-4fdb-96a1-616f67d30764 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.240419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.241098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.241380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.241651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.242422 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.243799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.262052 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.263070 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.263413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.263788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.264480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.265853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.267213 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 387/786] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:24.283006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:24.284147 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:24.285575 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 400/787] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:24.290859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:24.410130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51bc2-4039-497a-8115-94e0781bff98 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.412867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:24.452817 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.453631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.453997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.454382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.456130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:24.456130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.456874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.463577 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 388/788] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:24.470583 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:24.572681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32ddd-2433-4c40-81ef-6289eb1410e1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.601318 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:24.607758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.608421 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.608697 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.608969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.609669 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:24.610007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.611383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7b6f8-5aeb-4743-9d4b-218179fa7dfa None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.616414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 401/789] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Jul 15 21:45:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:24.622333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:24.725010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f046-1738-4c94-b38c-42694257b0ff None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:24.759866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:24.760519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:24.760797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:24.761070 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:24.761799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:24.763189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b298a-6a07-4261-9a64-2b179ad131b0 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:24.783489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 389/790] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:26.577531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118974a-7e61-4ccd-9150-f1b57ff8759b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:26.578157 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118974a-7e61-4ccd-9150-f1b57ff8759b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:26.578157 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118974a-7e61-4ccd-9150-f1b57ff8759b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:26.579653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 402/791] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:26.585590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:26.586055 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:26.586141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:26.604235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:26.605446 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:26.624411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:26.682048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 390/792] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:26.705589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118974a-7e61-4ccd-9150-f1b57ff8759b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:26.816419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118974a-7e61-4ccd-9150-f1b57ff8759b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:26.858877 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:26.859703 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:26.859991 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:26.860271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:26.860938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:26.862422 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-8f8e1c40-c21a-4866-8e96-f1e79f505ab5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:26.881911 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:26.883004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:26.883843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 403/793] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:26.890067 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:26.995080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74ec2-9067-40d2-90d3-55217cebc04c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:27.000424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb13d9-81ef-4654-ac51-a5d2b6322d1f None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.000691 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb13d9-81ef-4654-ac51-a5d2b6322d1f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.001159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb13d9-81ef-4654-ac51-a5d2b6322d1f None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.002598 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 404/794] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:45:27.007631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.008110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.008382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.025934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:27.027116 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:27.031491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:27.032171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.032454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.032731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.033445 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:27.033754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:27.035168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:27.040540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 391/795] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:27.046210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:27.061139 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:27.082096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:27.096397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 405/796] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:27 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:45:27.120913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:27.147054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e05f8b-1948-4d8b-9fe8-68cf876aaa66 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:27.180312 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:27.180990 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.181272 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.181552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.182304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:27.182609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:27.183978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:27.188728 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 392/797] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:45:27.252906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90bcdb-176e-419c-87b5-6d3d293f24f7 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:27.303950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:27.304630 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.304910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.305181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.305928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:27.307393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:27.308786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING keystone.server.flask.common [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 21:45:27.328917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.sql.core [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 21:45:27.328917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 21:45:27.328917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [parameters: {'id': '6fcd3226d2144ff3a925f21b2a5019eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 21:45:27.328917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fcd3226d2144ff3a925f21b2a5019eb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fcd3226d2144ff3a925f21b2a5019eb. Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application conn.query(q) Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 21:45:27.345746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result.read() Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 21:45:27.346728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application next(self.gen) Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application yield resource Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application next(self.gen) Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise self.value Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application session.commit() Jul 15 21:45:27.347746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.session.flush() Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application compat.raise_( Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 21:45:27.348959 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 21:45:27.350507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application conn.query(q) Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result.read() Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 21:45:27.351661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [parameters: {'id': '6fcd3226d2144ff3a925f21b2a5019eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:27.353153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:27.355081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6fcd3226d2144ff3a925f21b2a5019eb. Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:27.356444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 406/798] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Jul 15 21:45:27 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:45:27.357119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:27.442032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:27.465519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f418a9-6da5-48b5-a65a-3f4b107b2c27 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:27.501470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:27.502411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.502698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.503040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.510528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:27.511977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-4a26f231-3c25-4049-8a78-f36132922f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:45:27.526569 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:27.527540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:27.528528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 393/799] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:27.534581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:27.589832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:27.648111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16620bf-82ab-4eef-9ec7-ab17354ff2cd None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:27.686271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:27.686942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:27.687221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:27.687495 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:27.688255 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:27.688566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:27.690240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979d7e-7ba6-4493-ba7a-e340ac1efb2f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:27.712118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 407/800] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:29.397786 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd3c6-854c-4fce-b4f6-5eef346192fa None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:29.398324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd3c6-854c-4fce-b4f6-5eef346192fa None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:29.398324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd3c6-854c-4fce-b4f6-5eef346192fa None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:29.399758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 394/801] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:29.405681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4301d7f-7d64-468f-84cb-124d542cdc30 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:29.406152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4301d7f-7d64-468f-84cb-124d542cdc30 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:29.406240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4301d7f-7d64-468f-84cb-124d542cdc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:29.426141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-f4301d7f-7d64-468f-84cb-124d542cdc30 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:29.428181 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-f4301d7f-7d64-468f-84cb-124d542cdc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:29.498381 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 408/802] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:29.522239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cd3c6-854c-4fce-b4f6-5eef346192fa None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:29.633894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cd3c6-854c-4fce-b4f6-5eef346192fa None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:29.668633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:29.669287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:29.669566 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:29.669836 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:29.670590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:29.671958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec417a0-c4a2-43a7-9845-eab3c9367e27 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:29.681057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:29.687800 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 395/803] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:45:29 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:29.976842 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fe495-d369-4aff-b067-0b1ed6d930b8 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:29.977040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fe495-d369-4aff-b067-0b1ed6d930b8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:29.977289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fe495-d369-4aff-b067-0b1ed6d930b8 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:29.978735 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 409/804] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:29.984830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:29.985199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:29.985766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:30.005369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:30.006626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:30.082448 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 396/805] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:29 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:30.108109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fe495-d369-4aff-b067-0b1ed6d930b8 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:30.144733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:30.215812 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fe495-d369-4aff-b067-0b1ed6d930b8 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:30.253968 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:30.254588 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:30.255028 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:30.255315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:30.256026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:30.259708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:30.274416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.sql.core [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 21:45:30.274416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 21:45:30.274416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [parameters: {'user_id': '865658c4954e46828444a844e724c82f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 21:45:30.274416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application conn.query(q) Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result.read() Jul 15 21:45:30.282099 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 21:45:30.283005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application next(self.gen) Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application yield resource Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application next(self.gen) Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise self.value Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application session.commit() Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 21:45:30.283964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.session.flush() Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application compat.raise_( Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 21:45:30.284881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 21:45:30.285794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application conn.query(q) Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application result.read() Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 21:45:30.286684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [parameters: {'user_id': '865658c4954e46828444a844e724c82f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:30.287525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 21:45:30.291791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:30.292974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 410/806] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Jul 15 21:45:30 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:30.293462 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:30.395710 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd8e71-270f-421e-8c46-169f8066262d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:30.419927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:30.433541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:30.434555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:30.434838 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:30.435112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:30.443795 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:30.445244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-dea9c454-0994-4dde-a0ee-a832c32f0754 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:45:30.460009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:30.461173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:30.462457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 397/807] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:45:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:30.467690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:30.568005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:30.575685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec91e-afd7-4b4e-ae64-feb81d0d2683 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:30.611048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:30.611744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:30.612028 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:30.612307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:30.613119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:30.613427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:30.615291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7b09-fbd8-4490-9826-350fcc490a7d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:30.652382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 411/808] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Jul 15 21:45:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:31.900531 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bfaa-543f-47f4-b87c-d7a0c07a6089 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:31.901449 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bfaa-543f-47f4-b87c-d7a0c07a6089 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:31.901449 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bfaa-543f-47f4-b87c-d7a0c07a6089 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:31.904084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 398/809] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:31.913200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:31.913617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:31.913828 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:31.937265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:31.938853 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:32.010235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 412/810] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:31 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:32.038549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644bfaa-543f-47f4-b87c-d7a0c07a6089 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:32.147462 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644bfaa-543f-47f4-b87c-d7a0c07a6089 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:32.183124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:32.183910 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:32.184195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:32.184471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:32.185121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:32.186536 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:32.198559 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:32.199696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:45:32.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 399/811] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:32.205804 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:32.292858 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:32.309880 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a57c7-eb90-42c4-b6b8-93d6e2f12059 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:32.343385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:32.344042 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:32.344324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:32.344602 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:32.345314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] RBAC: Adding query filter params (name=compute) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:32.345626 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:32.347035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:32.352081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 413/812] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:32.358867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:32.425128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:32.487087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318c46-e370-455d-b73c-f4d5b936efe3 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:32.526533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:32.527959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:32.528247 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:32.528527 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:32.529608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:32.531416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:32.531416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:32.536861 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 400/813] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:32.543194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:32.648633 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77425a9b-24f8-460e-bc76-2623bc72568d None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:32.686442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:32.687084 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:32.687372 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:32.687642 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:32.688439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] RBAC: Adding query filter params (interface=public, service_id=b2dbfd25f58445fdbfbda2a8ebe1ce36, region_id=RegionOne) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:32.688756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:32.690231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc5a1-9351-4bda-a2a4-9584153d3ae8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:32.695453 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 414/814] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:45:32 2022] GET /identity/v3/endpoints?service_id=b2dbfd25f58445fdbfbda2a8ebe1ce36&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:32.704087 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:32.810107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de1945-926a-4582-9485-8ad133c67b62 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:32.822979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:32.855661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:32.856314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:32.856599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:32.856874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:32.857557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:32.858977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741851-d7d3-4495-84b5-d4f231c3f7c8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:32.865340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 401/815] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:45:32 2022] GET /identity/v3/services => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:45:35.136424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a0ea-547e-4e9a-b3a3-75286b762d9d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.137002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a0ea-547e-4e9a-b3a3-75286b762d9d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.137002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a0ea-547e-4e9a-b3a3-75286b762d9d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.138416 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 415/816] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:45:35.144813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.145291 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.145488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.169376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:45:35.170595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:45:35.257340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 402/817] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:45:35 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:45:35.281613 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a0ea-547e-4e9a-b3a3-75286b762d9d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:35.298899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:35.392379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a0ea-547e-4e9a-b3a3-75286b762d9d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:35.434048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:35.434840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.435121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.435396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.436052 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:35.437425 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:45:35.449344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:45:35.450485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:45:35.451487 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 416/818] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:45:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:45:35.456866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:35.567600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd67-7da6-4a46-ab4e-fbac784da91a None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:35.574929 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:35.604091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:35.604767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.605048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.605324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.606066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:35.606380 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:35.607755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:35.612512 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 403/819] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:35.619308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:35.721382 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:35.750037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f55b-bc08-4219-90eb-565c2995895f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:35.789047 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:35.790041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.790444 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.790833 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.791966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:45:35.792411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:35.794338 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a438-3335-40b5-af6c-928ad1214916 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:35.802203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 417/820] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Jul 15 21:45:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:45:35.808488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:45:35.930649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7390-02c6-490e-a928-33bf7691e90a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:45:35.964793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:45:35.965458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:45:35.965738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:45:35.966041 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:45:35.966776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:45:35.968143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3a946-9b47-4dd2-a816-ac010af9fcff None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:45:35.990124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 404/821] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:45:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:45:45.798342 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=30 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:45:45.982571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:36.976195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724ce8-6233-4e85-92aa-d4dbfa9557bd None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:36.976832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724ce8-6233-4e85-92aa-d4dbfa9557bd None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:36.976942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724ce8-6233-4e85-92aa-d4dbfa9557bd None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:36.978801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 418/822] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:36.984868 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:36.985369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:36.985614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:37.004225 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:37.005878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:37.097746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 405/823] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:46:37.127468 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724ce8-6233-4e85-92aa-d4dbfa9557bd None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:37.247776 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724ce8-6233-4e85-92aa-d4dbfa9557bd None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:37.293350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:37.294198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:37.294480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:37.294760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:37.305415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:37.307036 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:37.325178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:37.326274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:37.327260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:37.327260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:37.327260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:37.327260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:37.327260 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 419/824] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:37.333270 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:37.446829 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fe4c2-c117-438f-8530-3f3f31583c41 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:37.478344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:37.492867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:37.493699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:37.494233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:37.494553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:37.495616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:37.496043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:37.497740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3620f6-e09d-4280-8cf4-35f0971f1014 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:37.518209 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 406/825] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:37.519635 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:37.590476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:37.645393 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a64408-07d5-4744-9f5c-59e1cd9644cf None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:37.686244 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:37.686949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:37.687226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:37.687501 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:37.688214 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:37.689659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec887-d0cd-4f0a-b5c4-6a81f138f6b9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:37.711948 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 420/826] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Jul 15 21:46:37 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:46:40.113268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d070b-d9c0-4d16-a4ad-1a4d2078ac3a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.113896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d070b-d9c0-4d16-a4ad-1a4d2078ac3a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.113896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d070b-d9c0-4d16-a4ad-1a4d2078ac3a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.115223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 407/827] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:40.120881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.121300 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.121431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.138969 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:40.140173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:40.209400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 421/828] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:46:40.234002 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d070b-d9c0-4d16-a4ad-1a4d2078ac3a None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:40.355959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d070b-d9c0-4d16-a4ad-1a4d2078ac3a None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:40.396819 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:40.397670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.397992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.398372 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.409982 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:46:40.418588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:40.419787 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:40.420909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 408/829] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:46:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:40.426637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:40.468628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:40.538046 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6342e7d-a045-4722-a47d-8e37651b112c None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:40.576756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:40.577421 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.577702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.578008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.578757 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:40.579061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:40.580497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:40.589789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 422/830] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:46:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:40.595893 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:40.650216 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:40.706127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716faae-81f8-4903-b2fc-ef037a93a8fe None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:40.741908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:40.742719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.743004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.743279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.753578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:40.755185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:40.774943 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:40.776025 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:40.776920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:40.776920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:40.776920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:40.776920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:40.776920 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 409/831] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:40.782943 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:40.887958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:40.891509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c35a70-8bfc-407f-b146-f4f454bed567 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:40.930039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:40.930763 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:40.931090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:40.931477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:40.932354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:40.932659 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:40.934288 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:40.948184 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 423/832] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:40.956078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:41.071221 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:41.075417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148a7e-aa33-495d-adea-f5372466446f None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:41.112403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:41.113436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:41.114031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:41.114255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] PATH_INFO: `/v3/users/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:41.123689 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:41.125383 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:46:41.143283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:41.144374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:41.145477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 410/833] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:41.151737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:41.269283 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3902d-6f60-4c52-93c1-fa7ffb65add8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:41.313954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:41.314710 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:41.315016 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:41.315383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:41.316275 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:41.316603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:41.318323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:41.340516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 424/834] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:46:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:41.347089 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:41.463244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa1bd-0a35-433a-8df6-938e665347be None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:41.499932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:41.500571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:41.500868 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:41.501139 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:41.531172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:41.577325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:41.579063 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:41.692043 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 411/835] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:46:41 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 21:46:41.698794 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:41.719964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:41.813101 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57cfd9-d226-4242-bfc0-2d5a4bbb72c0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:41.852235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:41.853040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:41.853320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:41.853591 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:41.864474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:41.865998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:41.884684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:41.885985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:41.887035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:41.887035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:41.887035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:41.887035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:41.887035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 425/836] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:41.892241 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:41.955077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:42.001723 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccda1-23ad-4dc4-aff0-0b0ce422dcb5 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:42.043848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:42.044516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:42.044799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:42.045076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:42.045806 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:42.046138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:42.047615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:42.059477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 412/837] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:42.065397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:42.140623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:42.177010 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfada3-7d4d-47ba-874f-35cf2dc43603 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:42.215195 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:42.215999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:42.216280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:42.216554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:42.223225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:42.224665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:46:42.240168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:42.241638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:42.242574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 426/838] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:46:42.247675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:42.358340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7078f-8a8f-4bb3-8636-235c221fe9ae None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:42.376861 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:42.394632 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:42.395367 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:42.395586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:42.395980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:42.396773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:42.397122 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:42.398773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8921b-9033-4ba4-a83a-6ea4fc670369 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:42.413116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 413/839] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:46:42.419321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:42.538919 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057199b-2ca4-450a-938e-3b425cd9cecf None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:42.576007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:42.584054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:42.585931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:42.586502 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:42.587121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:42.588465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=02bf2cc0bb194d19ac539163798a09fc) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:42.588917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:42.591388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd509e-d910-46ed-b299-2cd8082d0afb None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:42.599830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 427/840] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:46:42 2022] GET /identity/v3/role_assignments?user.id=02bf2cc0bb194d19ac539163798a09fc&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:45.050989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a04b1-8493-4292-ace4-38ff8458d7dd None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.051626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a04b1-8493-4292-ace4-38ff8458d7dd None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.051626 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a04b1-8493-4292-ace4-38ff8458d7dd None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.053250 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 414/841] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:45.059358 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.059877 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.060080 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.077594 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:45.078957 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:45.150804 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 428/842] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:46:45.175197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a04b1-8493-4292-ace4-38ff8458d7dd None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:45.289129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a04b1-8493-4292-ace4-38ff8458d7dd None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:45.325740 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:45.326512 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.326796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.327072 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.337278 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:46:45.344989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:45.346110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:45.347013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 415/843] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:46:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:45.352863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:45.460500 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac21b8-93ff-4026-9489-e3586b1163d6 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:45.484609 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:45.496194 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:45.496872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.497153 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.497430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.498207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:45.498521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:45.499916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:45.513586 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 429/844] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:45.514940 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:45.557218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:45.622847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1490b-43ea-4973-b102-b0d01d126945 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:45.660066 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:45.660856 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.661141 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.661418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.672680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:45.674224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:45.695931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:45.697703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:45.699474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:45.699474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:45.699474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:45.699474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:45.704608 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 416/845] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:45.705680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:45.828362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e230f-046b-44fb-b276-b6e1c11182b0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:45.871218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:45.872095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:45.872378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:45.872648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:45.873415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:45.873676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:45.875121 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:45.888026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 430/846] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:45.894115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.003600 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:46.017192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ae40c-6461-42a2-aa25-c1e10c5ad03d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:46.062716 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:46.063621 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:46.063954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:46.064237 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:46.073111 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:46.074798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:46:46.090678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:46.092107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:46.093143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 417/847] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:46.099004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.166497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:46.245440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891ea7-b709-4899-9035-56c1ff05247b None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:46.284312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:46.285057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:46.285368 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:46.285646 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:46.286648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:46.286991 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:46.288978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:46.311334 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 431/848] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:46:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:46.317959 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.429502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591fe1-d247-47e1-bd48-058d746d2941 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:46.469399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:46.470388 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:46.470665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:46.470931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:46.482641 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:46.484119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:46.502443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:46.503506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:46.504506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:46.504506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:46.504506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:46.504506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:46.504506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 418/849] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:46.512914 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.623002 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35696c0-bdcb-4fb2-80a0-81201f8b757a None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:46.625742 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:46.660950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:46.661616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:46.661935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:46.662215 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:46.662945 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:46.663276 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:46.664852 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:46.676934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 432/850] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:46.683057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.686107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:46.787864 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced29e79-f446-4f61-b4ab-2c65a17042bc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:46.822684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:46.823624 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:46.823915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:46.824188 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:46.832464 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:46.834117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:46:46.850116 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:46.851203 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:46.852171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 419/851] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:46.857582 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:46.967938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a719-dfb3-4035-b952-7fcd2e8417a4 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:47.008216 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:47.009362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:47.009855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:47.010340 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:47.011411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:47.011890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:47.014483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022093ec-7321-4e66-a277-bcb3575af674 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:47.031984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 433/852] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:47.041631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:47.121008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:47.162706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99eee-452b-4a9c-a9f6-16cbc3577d57 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:47.198130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:47.199034 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:47.199308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:47.199581 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/02bf2cc0bb194d19ac539163798a09fc/roles/6f1030b115384d4d8d1b2c36d50d5c02` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:47.214373 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=02bf2cc0bb194d19ac539163798a09fc, role_id=6f1030b115384d4d8d1b2c36d50d5c02)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:47.215842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c98b-b483-4e30-ba1d-468a2ae55df3 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:47.229505 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 420/853] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:46:47 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/02bf2cc0bb194d19ac539163798a09fc/roles/6f1030b115384d4d8d1b2c36d50d5c02 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:46:49.474116 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71574-9ac7-495a-ae52-cf5e14c88306 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:49.474666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71574-9ac7-495a-ae52-cf5e14c88306 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:49.474666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71574-9ac7-495a-ae52-cf5e14c88306 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:49.476509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 434/854] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:49.481923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:49.482590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:49.483037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:49.502144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:49.503862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:49.577379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 421/855] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:46:49.603539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f71574-9ac7-495a-ae52-cf5e14c88306 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:49.630849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:49.709841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f71574-9ac7-495a-ae52-cf5e14c88306 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:49.745558 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:49.746483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:49.746835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:49.747090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:49.762673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:46:49.770771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:49.777460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:49.779127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 435/856] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Jul 15 21:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:49.779956 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:49.825857 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:49.889033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b70a0-7d83-4292-b70a-2e816baac19f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:49.924622 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:49.925292 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:49.925571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:49.925841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:49.926652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:49.926966 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:49.928365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:49.938129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 422/857] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Jul 15 21:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:49.944264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:50.046012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:50.063580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c6724-54a7-4aa1-8c91-1ae5862a1b70 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:50.099999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:50.100891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:50.101176 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:50.101435 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:50.111745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:50.113192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:50.130409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:50.131473 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:50.132811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:50.132811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:50.132811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:50.132811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:50.132811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 436/858] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:50.137988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:50.248265 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4a79f-fb52-4b8f-b483-1de8d51b8d5c None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:50.251207 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:50.284924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:50.285640 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:50.285905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:50.286219 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:50.287059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:50.287402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:50.289217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:50.301797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 423/859] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:50.308081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:50.428691 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb811-b033-44e8-9578-ecca99ecaba9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:50.472436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:50.473328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:50.473651 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:50.473952 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:50.477422 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:50.483249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:50.484937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:46:50.501449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:50.502424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:50.503573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:50.508015 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 437/860] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:50.509192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:50.621012 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931307-4e1e-4b47-9094-489424fd897a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:50.659537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:50.660324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:50.660726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:50.661030 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:50.662062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:50.662392 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:50.664552 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:50.682958 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 424/861] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:46:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:46:50.688937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:50.806142 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a364-0a3d-444e-a1c9-61f1a552b82e None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:50.844939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:50.845819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:50.846269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:50.846676 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:50.924858 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:50.933994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:50.935629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.054056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 438/862] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:46:50 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 21:46:51.060614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:51.089054 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:51.172383 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e344-2d5f-488b-8480-d6564f87e261 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:51.213458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:51.214443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:51.214759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:51.215041 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:51.228240 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:51.229694 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:51.248100 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:51.249238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:51.250384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:51.250384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:51.250384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:51.250384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:51.250384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 425/863] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:51.256398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:51.369617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:51.376321 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedcaec-299a-4135-9b87-6988b85c6cd0 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:51.415825 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:51.416771 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:51.417089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:51.417368 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:51.418436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:51.418749 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:51.420504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.437905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 439/864] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:46:51.439427 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:51.534090 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:51.562636 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504ef2-0897-4851-adbb-5994ed1e857b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:51.602550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:51.603424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:51.603840 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:51.604216 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:51.612572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:51.614831 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:46:51.633585 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:51.634583 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:51.635517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 426/865] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:51.642178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:51.755537 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abf67-4f13-43ce-9e91-80e7676be2d8 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:51.792110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:51.793054 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:51.793331 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:51.793608 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:51.794427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:51.794734 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:51.796206 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b3f8f-d60c-457d-bad9-21f0cd34c905 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.813169 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 440/866] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:51.821643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:51.950519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c68d79-552a-4bea-ad12-66967f76c6f4 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:51.989752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:51.990461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:51.990835 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:51.991052 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:51.991960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] RBAC: Adding query filter params (role.id=6f1030b115384d4d8d1b2c36d50d5c02, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=02bf2cc0bb194d19ac539163798a09fc) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:51.992276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:51.993794 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb8b4-8745-4ffe-8c25-128b1290e8b7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:51.996876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:52.003437 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 427/867] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:46:51 2022] GET /identity/v3/role_assignments?user.id=02bf2cc0bb194d19ac539163798a09fc&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=6f1030b115384d4d8d1b2c36d50d5c02 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:54.562125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807490-dfc6-4499-b7fd-6052eec7e428 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:54.562827 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807490-dfc6-4499-b7fd-6052eec7e428 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:54.562827 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807490-dfc6-4499-b7fd-6052eec7e428 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:54.564483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 441/868] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:54.571454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:54.572047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:54.572148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:54.593103 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:54.594333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:54.677431 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 428/869] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:46:54.706781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807490-dfc6-4499-b7fd-6052eec7e428 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:54.730292 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:54.829528 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807490-dfc6-4499-b7fd-6052eec7e428 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:54.870808 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:54.871904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:54.872296 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:54.872610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:54.885093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:46:54.892716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:54.894093 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:54.895291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 442/870] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:46:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:54.900328 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.006379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e073-53d2-4dc2-800e-dcbd9944de70 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.042734 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:55.052359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20827-6771-4684-a515-74429596a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:55.053023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20827-6771-4684-a515-74429596a481 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:55.053365 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20827-6771-4684-a515-74429596a481 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:55.053564 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20827-6771-4684-a515-74429596a481 None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:55.054522 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c20827-6771-4684-a515-74429596a481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:55.055010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c20827-6771-4684-a515-74429596a481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:55.056439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c20827-6771-4684-a515-74429596a481 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:55.067265 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 429/871] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:55.075026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.165457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:55.191993 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf877f-6527-480a-a8b1-ed8e6e161df3 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.233524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:55.234363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:55.234644 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:55.234954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:55.247864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:55.249531 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:55.271788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:55.273173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:55.274152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:55.274152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:55.274152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:55.274152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:55.274152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 443/872] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 21:46:55.280647 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20827-6771-4684-a515-74429596a481 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.394047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20827-6771-4684-a515-74429596a481 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.432336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:55.433032 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:55.433310 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:55.433774 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:55.434697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:55.435007 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:55.436389 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:55.449724 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 430/873] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:55.455674 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.567359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f44a0-1f28-44c9-9d84-8a8527245857 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.597390 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:55.605543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:55.606462 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:55.606807 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:55.607150 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] PATH_INFO: `/v3/users/placement` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:55.616064 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:55.618258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:46:55.633262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:55.634350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:55.635295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 444/874] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:55.643231 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.706444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:55.774345 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933646c3-9c38-4021-b1fb-a4bf58117457 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.812758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:55.813904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:55.814444 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:55.814876 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:55.815720 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:55.816029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:55.817645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:55.837907 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 431/875] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:46:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:55.844191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:55.959513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae17c-f617-4c07-b975-8a4ce0db8def None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:55.999727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:56.000552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:56.000843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:56.001130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:56.070826 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:56.085435 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:56.086938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:56.195537 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 445/876] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:46:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 21:46:56.202148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:56.310538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b39a-ae9a-40ee-87b2-9f296fb599a7 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:56.322828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:56.351519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:56.352451 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:56.352731 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:56.353033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:56.365245 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:56.367083 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:56.385381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:56.386766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:56.387901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:56.387901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:56.387901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:56.387901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:56.391904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 432/877] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:56.393148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:56.499439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:56.514728 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631344-3237-44aa-9793-8115ad66f4f9 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:56.553109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:56.554013 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:56.554357 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:56.554637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:56.555429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:56.555768 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:56.557340 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:56.570143 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 446/878] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:56.576450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:56.689434 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7245fb-8d7f-4bf7-a0e8-2791aec5d30b None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:56.727125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:56.727956 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:56.728236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:56.728508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:56.736501 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:56.738015 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:46:56.753470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:56.754520 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:46:56.761539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 433/879] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:56.762231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:56.874217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468636-f8f2-419e-bc8a-4c4b8c368cdc None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:56.912200 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:56.912883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:56.913297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:56.913597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:56.914777 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:56.915089 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:56.916587 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db539a-836b-47ba-87b5-790f88100f37 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:56.930699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 447/880] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:56.937185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:56.966049 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:57.069810 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9d97-47dc-4afd-a1c9-46b33b286ece None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:57.108664 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:57.109338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:57.109616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:57.109917 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:57.110751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=02bf2cc0bb194d19ac539163798a09fc) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:57.111059 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:57.112535 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d3c7a-6fa2-4094-9ec4-a673d7a6734d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:57.119144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 434/881] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:46:56 2022] GET /identity/v3/role_assignments?user.id=02bf2cc0bb194d19ac539163798a09fc&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:59.307737 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2134-3491-475d-9100-5b1755082ccb None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:59.308614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2134-3491-475d-9100-5b1755082ccb None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:59.308614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2134-3491-475d-9100-5b1755082ccb None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:59.310897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 448/882] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:46:59.316494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:59.316927 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:59.317033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:59.338610 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:46:59.340540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:46:59.425725 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 435/883] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:46:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:46:59.451319 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2134-3491-475d-9100-5b1755082ccb None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:59.463722 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:59.566837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2134-3491-475d-9100-5b1755082ccb None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:59.605490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:59.606313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:59.606604 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:59.606878 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:59.618805 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:46:59.626391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:59.627434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:46:59.628454 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:59.630066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 449/884] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:46:59.634933 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:59.656051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:59.751382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e640d-4268-4911-8893-40cefdd33847 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:59.791009 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:59.791697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:59.791976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:59.792246 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:59.792995 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:46:59.793299 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:59.794707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:59.802978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 436/885] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:46:59.809325 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:46:59.890106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:46:59.926741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708adb1-666b-43d0-8484-32855daa4588 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:46:59.962971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:46:59.963762 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:46:59.964044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:46:59.964312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:46:59.975407 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:46:59.976939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:46:59.994383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:46:59.995843 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:46:59.997554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:46:59.997554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:46:59.997554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:46:59.997554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:46:59.997554 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 450/886] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:00.004358 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.091112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:00.114560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749f27-b2f2-41d2-90aa-6ed31dd0c15a None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:00.148144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:00.148735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:00.149022 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:00.149300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:00.150048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:00.150360 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:00.151749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:00.164542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 437/887] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:00.171352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.278420 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170295f-d2a8-4a18-8d58-ac8086ed4e43 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:00.298845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:00.314148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:00.314953 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:00.315241 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:00.315486 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:00.323127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:00.324579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:47:00.338921 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:00.340008 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:47:00.341041 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 451/888] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:00.346172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.465909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25973ab-7b1d-4f80-9018-7ae731dfa5d2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:00.503456 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:00.504115 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:00.504400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:00.504682 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:00.505522 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:00.505835 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:00.507474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:00.510627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:00.525857 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 438/889] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:47:00.534792 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.634330 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b871b-ebd3-40dd-b623-c7546a4a1787 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:00.676629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:00.677421 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:00.677699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:00.677983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:00.688945 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:00.690434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:47:00.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:00.708695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:00.709601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:47:00.709601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:47:00.709601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:00.709601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:47:00.709601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 452/890] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:00.714798 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.817603 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215953-12fe-4d48-b21a-e3862ae0adbc None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:00.851912 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:00.852560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:00.852843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:00.853110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:00.853823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:00.854159 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:00.855519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:00.866853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 439/891] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:00.872715 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:00.907787 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:00.978346 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37ad6b-195a-46fe-908e-d25a00340341 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:01.031502 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:01.032490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:01.032924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:01.033539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:01.043095 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:01.045281 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:47:01.063045 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:01.064043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:47:01.065094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 453/892] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:01.072692 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:01.132690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:01.181097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4c4e-f0e5-42f6-8735-c4e3d3b08571 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:01.218071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:01.218738 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:01.219028 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:01.219314 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:01.220104 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:01.220419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:01.221890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6af9-ed03-48ef-87af-f0f734ea943d None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:01.234483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 440/893] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:01.243398 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:01.346086 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:01.359977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6096b9-f824-4f14-a4e5-f0fd274bc152 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:01.396606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:01.397506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:01.397795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:01.398103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] PATH_INFO: `/v3/projects/b107630b6535439b8e407711f8a194af/users/02bf2cc0bb194d19ac539163798a09fc/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:01.400768 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b107630b6535439b8e407711f8a194af, user_id=02bf2cc0bb194d19ac539163798a09fc, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:01.402322 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe86eb3-323b-447d-a310-f2707a1fe9e8 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:01.417465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 454/894] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Jul 15 21:47:01 2022] PUT /identity/v3/projects/b107630b6535439b8e407711f8a194af/users/02bf2cc0bb194d19ac539163798a09fc/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:47:03.602555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66543-aa5b-48f8-ae03-76ae13201742 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:03.603218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66543-aa5b-48f8-ae03-76ae13201742 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:03.603218 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c66543-aa5b-48f8-ae03-76ae13201742 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:03.605197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 441/895] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:47:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:47:03.613159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286722-90ba-4558-bd84-546656f14264 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:03.613612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286722-90ba-4558-bd84-546656f14264 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:03.613725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286722-90ba-4558-bd84-546656f14264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:03.632227 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2f286722-90ba-4558-bd84-546656f14264 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:47:03.633499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2f286722-90ba-4558-bd84-546656f14264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:47:03.705375 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 455/896] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:47:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:47:03.730921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c66543-aa5b-48f8-ae03-76ae13201742 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:03.838726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c66543-aa5b-48f8-ae03-76ae13201742 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:03.852939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:03.875714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:03.876500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:03.876778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:03.877052 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:03.888417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 21:47:03.895889 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:03.896954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:03.898051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 442/897] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Jul 15 21:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:03.904023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286722-90ba-4558-bd84-546656f14264 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:03.987681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:04.008628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286722-90ba-4558-bd84-546656f14264 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.049252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.050018 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.050377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.050660 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:04.051566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:04.051935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:04.053573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:04.064222 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 456/898] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Jul 15 21:47:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 21:47:04.070808 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:04.178577 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c2c9-9cae-4fca-aa49-e89d4d63793d None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.215978 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.216816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.217023 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.217332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:04.228447 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:04.229902 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:47:04.247511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:04.248525 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:04.249596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:47:04.249596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:47:04.249596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:04.249596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:04.249596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 443/899] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:04.257485 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:04.369675 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa21b1-e270-4f9f-9f3e-a59e72f9a9d1 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.406825 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.407478 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.407764 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.408043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:04.408785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:04.409102 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:04.410526 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:04.422741 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 457/900] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:04.428758 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:04.457755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:04.545200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3fa3-0e1c-4a3e-b717-845dd8f12354 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.587839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.588650 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.588930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.589204 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:04.597392 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:04.598862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 21:47:04.613631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:04.615046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:04.616137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 444/901] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:47:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:04.620989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:04.625020 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:04.741785 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c2f-8c80-4efd-afe9-6c66569499e5 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.778120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.779141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.779418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.779693 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:04.780527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:04.780841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:04.782295 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:04.799798 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 458/902] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Jul 15 21:47:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:04.808261 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:04.896546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:04.912799 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00ab3-9496-4492-96bc-7a57a86a2d9e None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:04.948807 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:04.949443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:04.949719 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:04.950137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:05.025327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:05.026918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:05.117325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:05.136937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 445/903] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Jul 15 21:47:04 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 21:47:05.143688 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:05.210486 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:05.251171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59cb70-322a-421c-b27a-068cc697928f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:05.291917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:05.292708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:05.292984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:05.293249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:05.304305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:05.306123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 21:47:05.324110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:05.325113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:05.326298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 21:47:05.326298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 21:47:05.326298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 21:47:05.326298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:47:05.326298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 459/904] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:05.334117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:05.450119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c58-e702-4e11-b2d4-df0bd78a8f98 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:05.485211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:05.485885 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:05.486186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:05.486460 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:05.487189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:05.487499 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:05.488870 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:05.500307 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 446/905] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Jul 15 21:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:05.507253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:05.617618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5c8cf-2744-4ae3-b58e-56fd751b9a42 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:05.633616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:05.658839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:05.659535 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:05.659813 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:05.660091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:05.667516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:05.668962 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 21:47:05.683387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:05.684410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: ERROR keystone.server.flask.application Jul 15 21:47:05.685677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 460/906] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Jul 15 21:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:05.693088 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:05.756325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:05.819502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24414-0eae-4c98-bcf6-49f12ea172a2 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:05.857117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:05.857766 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:05.858077 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:05.858351 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:05.859124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:05.859433 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:05.860866 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070e0d3-d403-45a5-a104-f62febb282a4 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:05.872960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 447/907] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Jul 15 21:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:05.882505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:06.005161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f48-6ccb-4c0c-8711-4c24d68f936f None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:06.043800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:06.044445 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:06.044721 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:06.044999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:06.045819 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] RBAC: Adding query filter params (role.id=2d994bc4bf4f4e3287429d64fb393a8d, scope.project.id=b107630b6535439b8e407711f8a194af, user.id=02bf2cc0bb194d19ac539163798a09fc) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:06.046165 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:06.047611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e0b2-b5b8-4dc6-b855-ac5aa42fbd3a None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:06.053648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 461/908] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Jul 15 21:47:05 2022] GET /identity/v3/role_assignments?user.id=02bf2cc0bb194d19ac539163798a09fc&scope.project.id=b107630b6535439b8e407711f8a194af&role.id=2d994bc4bf4f4e3287429d64fb393a8d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:08.265726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9495698-17db-4967-846a-aa97fef3e57c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:08.266691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9495698-17db-4967-846a-aa97fef3e57c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:08.266691 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9495698-17db-4967-846a-aa97fef3e57c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:08.268830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 448/909] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:47:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:47:08.274410 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:08.274834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:08.274949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:08.294017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:47:08.295196 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:47:08.325708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:08.368241 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 462/910] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:47:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:47:08.391863 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9495698-17db-4967-846a-aa97fef3e57c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:08.501125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9495698-17db-4967-846a-aa97fef3e57c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:08.508523 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:08.538138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:08.538865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:08.539144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:08.539417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:08.540350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:08.541890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:08.553750 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:08.554869 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:08.555809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 449/911] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Jul 15 21:47:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:08.562125 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:08.674299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0c6b-ff4b-4275-9525-fd28c9c74d80 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:08.709820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:08.710497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:08.710778 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:08.711051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:08.711947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] RBAC: Adding query filter params (name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:08.712249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:08.713623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd1e08-4567-47c2-b003-162ff92f352e None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:08.718956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 463/912] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Jul 15 21:47:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:08.727977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:08.833209 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb0bd3-4008-4868-b73f-70243e3e5fe8 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:08.868689 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:08.869343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:08.869622 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:08.869907 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] PATH_INFO: `/v3/services` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:08.870623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] RBAC: Adding query filter params (type=placement) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:08.870910 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:08.872281 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab39a6-46e8-4a0a-a6bf-59171439cd7c None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:08.876864 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 450/913] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Jul 15 21:47:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:11.153298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d6e6-af1d-436f-85b4-958daf3e843e None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:11.154253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d6e6-af1d-436f-85b4-958daf3e843e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:11.154253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d6e6-af1d-436f-85b4-958daf3e843e None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:11.155679 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 464/914] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:47:11.162090 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fb307-86e4-4b57-b0e8-e189e00e2440 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:11.162839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fb307-86e4-4b57-b0e8-e189e00e2440 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:11.162950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fb307-86e4-4b57-b0e8-e189e00e2440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:11.182782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-f77fb307-86e4-4b57-b0e8-e189e00e2440 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:47:11.183979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-f77fb307-86e4-4b57-b0e8-e189e00e2440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:47:11.214210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:11.276010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 451/915] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:47:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:47:11.307966 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d6e6-af1d-436f-85b4-958daf3e843e None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:11.348607 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:11.435191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d6e6-af1d-436f-85b4-958daf3e843e None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:11.471186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:11.472127 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:11.472550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:11.472967 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:11.474119 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:11.476255 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875202c-72d2-4a8b-9966-41801fb93795 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:11.497719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 465/916] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Jul 15 21:47:11 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:47:13.721816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68fd4-7d00-403f-9b45-9ed7c053f8bc None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:13.722509 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68fd4-7d00-403f-9b45-9ed7c053f8bc None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:13.722509 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68fd4-7d00-403f-9b45-9ed7c053f8bc None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:13.723778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 452/917] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:47:13.730205 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:13.730925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:13.731117 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:13.757497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:47:13.760301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:47:13.847198 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 466/918] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:47:13 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 21:47:13.871881 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68fd4-7d00-403f-9b45-9ed7c053f8bc None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:13.985540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68fd4-7d00-403f-9b45-9ed7c053f8bc None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:14.028166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:14.029352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:14.029638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:14.029905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:14.030601 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:14.031991 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:14.045171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:14.046364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:14.047196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 453/919] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Jul 15 21:47:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:14.053397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:14.079897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:14.165497 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005e18d-44c7-4135-9371-628d4b37db47 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:14.203310 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:14.203964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:14.204249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:14.204525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:14.205237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:14.205545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:14.206953 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:14.212265 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 467/920] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Jul 15 21:47:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:14.219200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:14.251062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:14.328321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7cc7-4319-4e4f-8962-5c422187f481 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:14.366202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:14.366851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:14.367129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:14.367399 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:14.368351 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] RBAC: Adding query filter params (interface=public, service_id=b06ec869a96d4ad68f5eef40a2fd3db0, region_id=RegionOne) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:14.368715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:14.370118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bab04-8a72-4793-9edd-cdbbb85d97ee None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:14.375792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 454/921] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Jul 15 21:47:14 2022] GET /identity/v3/endpoints?service_id=b06ec869a96d4ad68f5eef40a2fd3db0&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:14.384839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:14.483540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:14.504315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7420-fed5-4da2-b0e9-1d7843cf3562 None admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:14.541685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:14.542507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:14.542774 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:14.543071 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:14.543756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:14.545171 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7feee-3965-4aea-9767-6d28821229f1 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:14.551949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 468/922] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Jul 15 21:47:14 2022] GET /identity/v3/services => generated 1962 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:47:16.746560 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b14d-b2b9-4927-817c-92a4b0ba1d53 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:16.747414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b14d-b2b9-4927-817c-92a4b0ba1d53 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:16.747414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b14d-b2b9-4927-817c-92a4b0ba1d53 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:16.749653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 455/923] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:47:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:47:16.757579 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:16.758065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:16.758159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:16.781893 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:47:16.783113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:47:16.867044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 469/924] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:47:16 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 21:47:16.890685 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b14d-b2b9-4927-817c-92a4b0ba1d53 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:16.993187 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:17.010547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b14d-b2b9-4927-817c-92a4b0ba1d53 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:17.047540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:17.048752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:17.049202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:17.049627 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:17.050755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:17.052953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 21:47:17.073118 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 21:47:17.074284 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application with Lock( Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self._enter() Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application return self.creator() Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application created_value = creator( Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: ERROR keystone.server.flask.application Jul 15 21:47:17.075233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 456/925] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Jul 15 21:47:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 21:47:17.080490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:17.163313 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:17.196301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40ba62-0290-443b-b2f8-c4428ee36fd0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:17.232740 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:17.233401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:17.233688 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:17.233999 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] PATH_INFO: `/v3/services` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:17.234711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:47:17.235026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:17.236415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4da5-b834-473a-8bcd-01098b42e068 None admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:17.241829 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 470/926] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Jul 15 21:47:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:47:17.251193 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:47:17.365344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965268-68b6-4d4f-a06d-958c382451c9 None admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:47:17.410411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:47:17.411402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:47:17.411754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:47:17.412019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:47:17.413202 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:47:17.415423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11775bb0-bc75-406e-9c9a-7d467dd94931 None admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:47:17.459200 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 457/927] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Jul 15 21:47:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:47:27.238746 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=30 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:47:27.453908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:48:16.543894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9461d-67c9-417b-be13-883f37b4e36d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:16.544559 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9461d-67c9-417b-be13-883f37b4e36d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:16.544791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9461d-67c9-417b-be13-883f37b4e36d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:16.546634 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 471/928] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:16.552127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f5c6-4c54-46b6-b424-215447b88ff4 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:16.552700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f5c6-4c54-46b6-b424-215447b88ff4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:16.552700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f5c6-4c54-46b6-b424-215447b88ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:16.575252 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-b549f5c6-4c54-46b6-b424-215447b88ff4 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:16.577021 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b549f5c6-4c54-46b6-b424-215447b88ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:16.668189 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 458/929] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:16.722392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b337d-1dce-44f3-97c0-5dd222fd815b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:16.723001 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b337d-1dce-44f3-97c0-5dd222fd815b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:16.723452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b337d-1dce-44f3-97c0-5dd222fd815b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:16.725719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 472/930] 10.222.0.17 () {54 vars in 964 bytes} [Fri Jul 15 21:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:16.732710 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa23c-2dda-406d-83d3-c15400e5bd6d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:16.733008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa23c-2dda-406d-83d3-c15400e5bd6d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:16.733289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa23c-2dda-406d-83d3-c15400e5bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:16.803239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-ffeaa23c-2dda-406d-83d3-c15400e5bd6d None None] MFA Rules not processed for user `661831a6f5214520a43b84201a4588db`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:16.804550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-ffeaa23c-2dda-406d-83d3-c15400e5bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:16.875190 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 459/931] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Jul 15 21:48:16 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:16.883994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b337d-1dce-44f3-97c0-5dd222fd815b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:16.896071 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b337d-1dce-44f3-97c0-5dd222fd815b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:16.900112 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:16.901097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:16.901097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:16.901097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:16.912015 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:16.914671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a544-ef3d-47f1-bb6a-21c776d9e644 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:16.938537 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 473/932] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:19.398142 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dcee-6bcf-46b8-8fe5-4d0d194a8089 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:19.399029 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dcee-6bcf-46b8-8fe5-4d0d194a8089 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:19.399386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dcee-6bcf-46b8-8fe5-4d0d194a8089 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:19.400935 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 460/933] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:19.406799 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255137f-4705-4f7a-a798-9a0ed9cb02f6 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:19.407250 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255137f-4705-4f7a-a798-9a0ed9cb02f6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:19.407346 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255137f-4705-4f7a-a798-9a0ed9cb02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:19.425851 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-6255137f-4705-4f7a-a798-9a0ed9cb02f6 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:19.427043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-6255137f-4705-4f7a-a798-9a0ed9cb02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:19.435373 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 474/934] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:19.486604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097701a8-6061-4683-8004-3f823246b7fa None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:19.486918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097701a8-6061-4683-8004-3f823246b7fa None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:19.487302 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097701a8-6061-4683-8004-3f823246b7fa None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:19.489487 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 461/935] 10.222.0.17 () {54 vars in 964 bytes} [Fri Jul 15 21:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:19.496104 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10800e-610c-4f3e-887b-61b0eb5be593 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:19.496519 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10800e-610c-4f3e-887b-61b0eb5be593 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:19.496935 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10800e-610c-4f3e-887b-61b0eb5be593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:19.516670 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-eb10800e-610c-4f3e-887b-61b0eb5be593 None None] MFA Rules not processed for user `661831a6f5214520a43b84201a4588db`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:19.517897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-eb10800e-610c-4f3e-887b-61b0eb5be593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:19.525680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 475/936] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Jul 15 21:48:19 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:19.535169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097701a8-6061-4683-8004-3f823246b7fa None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:19.547751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097701a8-6061-4683-8004-3f823246b7fa None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:19.551984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:19.552665 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:19.552953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:19.553228 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:19.564105 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:19.565571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d6db7-1527-4fc6-9cc5-d5e2993633c9 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:19.575743 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 462/937] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:22.343545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ca31-92ed-4b15-99bd-84079a19896c None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:22.344106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ca31-92ed-4b15-99bd-84079a19896c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:22.344106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ca31-92ed-4b15-99bd-84079a19896c None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:22.345625 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 476/938] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:22.351173 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cac6-bedf-40e4-a5d7-baf9e630e858 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:22.351746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cac6-bedf-40e4-a5d7-baf9e630e858 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:22.351746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cac6-bedf-40e4-a5d7-baf9e630e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:22.398620 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-ce79cac6-bedf-40e4-a5d7-baf9e630e858 None None] MFA Rules not processed for user `9eecf3fed1cc42fbb6133c4ef3971e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:22.400062 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-ce79cac6-bedf-40e4-a5d7-baf9e630e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:22.447675 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:48:22.478790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 463/939] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:22 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:22.518700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18ca31-92ed-4b15-99bd-84079a19896c None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:22.529801 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18ca31-92ed-4b15-99bd-84079a19896c None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:22.533270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:22.533932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:22.534219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:22.534488 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:22.543671 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:22.545322 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a1b36-6084-43f1-91aa-f8cb2ec5a192 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:22.555218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 477/940] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:22 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:25.355820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115f1f-0ffc-44c0-bed8-98b75e3a2a79 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:25.357703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115f1f-0ffc-44c0-bed8-98b75e3a2a79 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:25.357703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2115f1f-0ffc-44c0-bed8-98b75e3a2a79 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:25.358988 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 464/941] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:25.365369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0763b-e021-4b29-ab41-85c9c33dc53b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:25.366161 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0763b-e021-4b29-ab41-85c9c33dc53b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:25.366320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0763b-e021-4b29-ab41-85c9c33dc53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:25.388213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-0fa0763b-e021-4b29-ab41-85c9c33dc53b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:25.389017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-0fa0763b-e021-4b29-ab41-85c9c33dc53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:25.464997 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 478/942] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:25 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:25.508773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2115f1f-0ffc-44c0-bed8-98b75e3a2a79 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:25.521069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2115f1f-0ffc-44c0-bed8-98b75e3a2a79 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:25.524921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:25.525555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:25.525837 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:25.526144 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:25.536880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:25.539123 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f0087-0730-4943-a047-3a4198ebd537 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:25.550891 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 465/943] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:25 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:28.436884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad24-334a-4b75-b2ec-6d78d2a4aa16 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:28.437476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad24-334a-4b75-b2ec-6d78d2a4aa16 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:28.437476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad24-334a-4b75-b2ec-6d78d2a4aa16 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:28.439037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 479/944] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:28.444165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e3ed-e5f0-4199-af06-3766ac9a05ab None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:28.444596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e3ed-e5f0-4199-af06-3766ac9a05ab None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:28.444771 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e3ed-e5f0-4199-af06-3766ac9a05ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:28.465877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-6f06e3ed-e5f0-4199-af06-3766ac9a05ab None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:28.467119 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6f06e3ed-e5f0-4199-af06-3766ac9a05ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:28.476607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 466/945] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:28.513180 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dad24-334a-4b75-b2ec-6d78d2a4aa16 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:28.525156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dad24-334a-4b75-b2ec-6d78d2a4aa16 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:28.529466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:28.530139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:28.530476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:28.530766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:28.539955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:28.541442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dea02-23a8-485d-97bb-19cda4b80d88 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:28.551685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 480/946] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:30.800049 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895248-f6d6-4ff7-b868-015b9ff5e9ae None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:30.800622 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895248-f6d6-4ff7-b868-015b9ff5e9ae None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:30.800622 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895248-f6d6-4ff7-b868-015b9ff5e9ae None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:30.801851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 467/947] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:30.807230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d8be-3c94-474a-a79f-63cc00fbc016 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:30.807665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d8be-3c94-474a-a79f-63cc00fbc016 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:30.807767 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d8be-3c94-474a-a79f-63cc00fbc016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:30.827218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3ec2d8be-3c94-474a-a79f-63cc00fbc016 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:30.828415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3ec2d8be-3c94-474a-a79f-63cc00fbc016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:30.837053 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 481/948] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:30.873540 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98895248-f6d6-4ff7-b868-015b9ff5e9ae None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:30.885656 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98895248-f6d6-4ff7-b868-015b9ff5e9ae None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:30.889692 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:30.890362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:30.890642 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:30.890917 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:30.900212 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:30.901629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a78ad-6804-4630-afa0-fd07695eb58f service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:30.911223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 468/949] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:33.165850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a294-2451-4efc-9fc4-5366f6ef2fae None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:33.166437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a294-2451-4efc-9fc4-5366f6ef2fae None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:33.166437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a294-2451-4efc-9fc4-5366f6ef2fae None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:33.167724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 482/950] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:33.173051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f97fd-1d47-4079-a3e1-f8da3db7f616 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:33.173518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f97fd-1d47-4079-a3e1-f8da3db7f616 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:33.173609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f97fd-1d47-4079-a3e1-f8da3db7f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:33.192079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-585f97fd-1d47-4079-a3e1-f8da3db7f616 None None] MFA Rules not processed for user `9eecf3fed1cc42fbb6133c4ef3971e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:33.193297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-585f97fd-1d47-4079-a3e1-f8da3db7f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:33.202649 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 469/951] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:33 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:33.240905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a294-2451-4efc-9fc4-5366f6ef2fae None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:33.252077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a294-2451-4efc-9fc4-5366f6ef2fae None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:33.255457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:33.256096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:33.256379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:33.256655 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:33.265977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:33.267420 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac1287-b7c4-4bba-a571-fb0c03f61dba service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:33.276982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 483/952] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:33 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:35.709495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8cbf-3c7e-4c4a-8abb-f4c3591fe868 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:35.710112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8cbf-3c7e-4c4a-8abb-f4c3591fe868 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:35.710112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8cbf-3c7e-4c4a-8abb-f4c3591fe868 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:35.711457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 470/953] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:35.717562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf37c5-5048-4e43-9a2f-0fab6b3ed321 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:35.718148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf37c5-5048-4e43-9a2f-0fab6b3ed321 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:35.718148 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf37c5-5048-4e43-9a2f-0fab6b3ed321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:35.736977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-e1cf37c5-5048-4e43-9a2f-0fab6b3ed321 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:35.738218 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-e1cf37c5-5048-4e43-9a2f-0fab6b3ed321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:35.747781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 484/954] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:35.786199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8cbf-3c7e-4c4a-8abb-f4c3591fe868 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:35.798274 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8cbf-3c7e-4c4a-8abb-f4c3591fe868 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:35.802001 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:35.802670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:35.802954 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:35.803229 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:35.813609 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:35.815120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91204e37-8282-4531-aca3-e706cc3b7f1f service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:35.825770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 471/955] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:38.096308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8743-4052-4947-a83b-43d75aaa6008 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:38.096901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8743-4052-4947-a83b-43d75aaa6008 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:38.096901 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8743-4052-4947-a83b-43d75aaa6008 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:38.101910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 485/956] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:38.104556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922905e4-7061-4354-af6a-3b0d9e622804 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:38.104556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922905e4-7061-4354-af6a-3b0d9e622804 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:38.105098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922905e4-7061-4354-af6a-3b0d9e622804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:38.125534 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-922905e4-7061-4354-af6a-3b0d9e622804 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:38.127005 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-922905e4-7061-4354-af6a-3b0d9e622804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:38.136163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 472/957] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:38.177845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8743-4052-4947-a83b-43d75aaa6008 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:38.183623 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=68 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:48:38.190248 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8743-4052-4947-a83b-43d75aaa6008 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:38.193856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:38.194599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:38.194967 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:38.195311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:38.204519 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:38.205995 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267a46-443d-44ec-a318-130064701f34 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:38.215399 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 486/958] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:41.095483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edc13-2adb-4175-bc9f-98a7189bda31 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:41.096404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edc13-2adb-4175-bc9f-98a7189bda31 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:41.096404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edc13-2adb-4175-bc9f-98a7189bda31 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:41.098603 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 473/959] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:41.104930 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755f70-d020-40bb-a7d5-b62e504bd433 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:41.105369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755f70-d020-40bb-a7d5-b62e504bd433 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:41.105489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755f70-d020-40bb-a7d5-b62e504bd433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:41.129318 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-bc755f70-d020-40bb-a7d5-b62e504bd433 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:41.130527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-bc755f70-d020-40bb-a7d5-b62e504bd433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:41.139408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 487/960] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:41 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:41.180586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189edc13-2adb-4175-bc9f-98a7189bda31 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:41.194507 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189edc13-2adb-4175-bc9f-98a7189bda31 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:41.199097 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:41.199742 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:41.201117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:41.201408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:41.212124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:41.213572 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ae0df-bd37-484f-81b5-fc034cced39d service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:41.223860 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 474/961] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:41 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:45.510245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782658-416a-452e-8b74-91d21e7e04dd None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:45.510777 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782658-416a-452e-8b74-91d21e7e04dd None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:45.510777 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782658-416a-452e-8b74-91d21e7e04dd None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:45.512106 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 488/962] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:45.517369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebff41-10e3-45cd-8cfd-50062a32e09c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:45.517819 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebff41-10e3-45cd-8cfd-50062a32e09c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:45.517970 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebff41-10e3-45cd-8cfd-50062a32e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:45.537230 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-89ebff41-10e3-45cd-8cfd-50062a32e09c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:45.538818 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-89ebff41-10e3-45cd-8cfd-50062a32e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:45.548183 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 475/963] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:45.588006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782658-416a-452e-8b74-91d21e7e04dd None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:45.599869 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782658-416a-452e-8b74-91d21e7e04dd None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:45.603890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:45.604533 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:45.604814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:45.605085 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:45.615012 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:45.616460 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767cc9-e8a9-4bc5-9070-1e2179730c33 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:45.626355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 489/964] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:48.415976 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0595f-6b36-4ad6-aeb1-c6f08bea176f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:48.416514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0595f-6b36-4ad6-aeb1-c6f08bea176f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:48.416514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0595f-6b36-4ad6-aeb1-c6f08bea176f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:48.418098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 476/965] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:48.423709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b27e-59c5-4ea7-8333-5c92098eeca9 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:48.424141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b27e-59c5-4ea7-8333-5c92098eeca9 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:48.424247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b27e-59c5-4ea7-8333-5c92098eeca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:48.443177 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3012b27e-59c5-4ea7-8333-5c92098eeca9 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:48.444361 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3012b27e-59c5-4ea7-8333-5c92098eeca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:48.452779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 490/966] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:48.491521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0595f-6b36-4ad6-aeb1-c6f08bea176f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:48.503474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0595f-6b36-4ad6-aeb1-c6f08bea176f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:48.507385 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:48.507992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:48.508277 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:48.508558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:48.518486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:48.520400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbfc99-15bb-4c0e-974d-cf7d0eefa302 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:48.530654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 477/967] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:53.034212 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831864-aeeb-41ad-b40b-4cde75951d37 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:53.034774 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831864-aeeb-41ad-b40b-4cde75951d37 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:53.034774 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831864-aeeb-41ad-b40b-4cde75951d37 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:53.036164 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 491/968] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:53.041470 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293c28-e18f-4cc6-b185-2c272cc44d8c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:53.041980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293c28-e18f-4cc6-b185-2c272cc44d8c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:53.042069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293c28-e18f-4cc6-b185-2c272cc44d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:53.049198 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=54 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:48:53.062283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-01293c28-e18f-4cc6-b185-2c272cc44d8c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:53.063491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-01293c28-e18f-4cc6-b185-2c272cc44d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:53.071895 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 478/969] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:48:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:48:53.111280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a831864-aeeb-41ad-b40b-4cde75951d37 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:48:53.123885 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a831864-aeeb-41ad-b40b-4cde75951d37 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:48:53.127881 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:48:53.128526 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:53.128810 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:53.129083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:53.139412 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:48:53.141145 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea348-b18e-4bba-b748-4e30d7741282 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:48:53.154259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 492/970] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:48:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:48:58.618614 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a2c9-4a56-4f1d-8b29-081c780ab28c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:58.619508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a2c9-4a56-4f1d-8b29-081c780ab28c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:58.620010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119a2c9-4a56-4f1d-8b29-081c780ab28c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:58.621984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 479/971] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:48:58.627337 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacf8e-61e8-4abe-b97a-81e9f849ec08 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:48:58.628228 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacf8e-61e8-4abe-b97a-81e9f849ec08 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:48:58.628718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacf8e-61e8-4abe-b97a-81e9f849ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:48:58.666610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-66cacf8e-61e8-4abe-b97a-81e9f849ec08 None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:48:58.668130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-66cacf8e-61e8-4abe-b97a-81e9f849ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:48:58.741992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 493/972] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:48:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:03.057114 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=2 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:03.069446 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb18dc-c305-4313-872b-6941a79179ba None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:03.069769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb18dc-c305-4313-872b-6941a79179ba None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:03.070042 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb18dc-c305-4313-872b-6941a79179ba None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:03.071591 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 480/973] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:03.077007 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-08f5-4c46-84b1-b7207791d2b2 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:03.077977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-08f5-4c46-84b1-b7207791d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:03.078457 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-08f5-4c46-84b1-b7207791d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:03.097529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-de2fbf77-08f5-4c46-84b1-b7207791d2b2 None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:03.098738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-de2fbf77-08f5-4c46-84b1-b7207791d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:03.108111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 494/974] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:49:03 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:04.772708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0658fe-9e7c-4c18-b2b1-f00f82d73930 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:04.773319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0658fe-9e7c-4c18-b2b1-f00f82d73930 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:04.773319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0658fe-9e7c-4c18-b2b1-f00f82d73930 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:04.774830 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 481/975] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:04.780291 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded30d-41f0-4bcf-9769-f169eb70bd4b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:04.780725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded30d-41f0-4bcf-9769-f169eb70bd4b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:04.780835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded30d-41f0-4bcf-9769-f169eb70bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:04.800855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-33ded30d-41f0-4bcf-9769-f169eb70bd4b None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:04.802107 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-33ded30d-41f0-4bcf-9769-f169eb70bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:04.812363 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 495/976] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:49:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:08.857136 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae549-d746-4a8f-8dc9-83510711d869 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:08.857785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae549-d746-4a8f-8dc9-83510711d869 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:08.857918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae549-d746-4a8f-8dc9-83510711d869 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:08.859746 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 482/977] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:08.864964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df49d-a650-4426-bb84-84da6d99639e None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:08.865386 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df49d-a650-4426-bb84-84da6d99639e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:08.865490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df49d-a650-4426-bb84-84da6d99639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:08.872845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=69 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:08.887209 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-4e4df49d-a650-4426-bb84-84da6d99639e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:08.888834 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-4e4df49d-a650-4426-bb84-84da6d99639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:08.897648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 496/978] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:08.953980 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e125-ffb8-44b6-b985-0e79466c4d30 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:08.954325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e125-ffb8-44b6-b985-0e79466c4d30 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:08.954711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e125-ffb8-44b6-b985-0e79466c4d30 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:08.956489 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 483/979] 10.222.0.17 () {54 vars in 961 bytes} [Fri Jul 15 21:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:08.965035 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a084b-d8a3-4598-bfad-f07cb8ea1469 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:08.965560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a084b-d8a3-4598-bfad-f07cb8ea1469 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:08.967123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a084b-d8a3-4598-bfad-f07cb8ea1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:09.012573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-181a084b-d8a3-4598-bfad-f07cb8ea1469 None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:09.013847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-181a084b-d8a3-4598-bfad-f07cb8ea1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:09.087178 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 497/980] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Jul 15 21:49:08 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:09.095710 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e125-ffb8-44b6-b985-0e79466c4d30 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:09.110108 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e125-ffb8-44b6-b985-0e79466c4d30 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:09.115329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:09.116076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:09.116556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:09.116931 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:09.126595 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:09.128274 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e44cd2-87e7-4c5a-84f0-74fb88a04a4e service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:09.142158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 484/981] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:11.593781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169ab7-ecc0-4e6c-bd89-c3dc386e45f6 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:11.594367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169ab7-ecc0-4e6c-bd89-c3dc386e45f6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:11.594367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169ab7-ecc0-4e6c-bd89-c3dc386e45f6 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:11.595931 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 498/982] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:11.601099 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be029b-a91c-40b5-888b-f1fe687247c9 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:11.601550 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be029b-a91c-40b5-888b-f1fe687247c9 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:11.601629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be029b-a91c-40b5-888b-f1fe687247c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:11.620020 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e3be029b-a91c-40b5-888b-f1fe687247c9 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:11.621199 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e3be029b-a91c-40b5-888b-f1fe687247c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:11.629834 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 485/983] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:11.676465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169ab7-ecc0-4e6c-bd89-c3dc386e45f6 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:11.691230 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169ab7-ecc0-4e6c-bd89-c3dc386e45f6 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:11.696492 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:11.697139 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:11.697418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:11.697690 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:11.706377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:11.707956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e08100-b587-48fc-b087-6ddd95cb8374 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:11.717895 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 499/984] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:14.308558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169553-1d1e-4362-a681-f8f852d06c3b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:14.309044 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169553-1d1e-4362-a681-f8f852d06c3b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:14.309135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169553-1d1e-4362-a681-f8f852d06c3b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:14.311010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 486/985] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:14.316402 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b54d-b78a-489c-a61d-48de1e435582 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:14.316818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b54d-b78a-489c-a61d-48de1e435582 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:14.316958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b54d-b78a-489c-a61d-48de1e435582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:14.335638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-4f67b54d-b78a-489c-a61d-48de1e435582 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:14.336873 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-4f67b54d-b78a-489c-a61d-48de1e435582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:14.348429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 500/986] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:14.408446 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431d07-438a-4eac-ac14-1a5fa3d4676f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:14.408737 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431d07-438a-4eac-ac14-1a5fa3d4676f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:14.409236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431d07-438a-4eac-ac14-1a5fa3d4676f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:14.410808 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 487/987] 10.222.0.17 () {54 vars in 961 bytes} [Fri Jul 15 21:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:14.416788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0580e0-aeb8-45c5-8770-1a7b254a1470 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:14.417074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0580e0-aeb8-45c5-8770-1a7b254a1470 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:14.417549 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0580e0-aeb8-45c5-8770-1a7b254a1470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:14.437312 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3c0580e0-aeb8-45c5-8770-1a7b254a1470 None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:14.438548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3c0580e0-aeb8-45c5-8770-1a7b254a1470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:14.447075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 501/988] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Jul 15 21:49:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:14.455194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95431d07-438a-4eac-ac14-1a5fa3d4676f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:14.468699 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95431d07-438a-4eac-ac14-1a5fa3d4676f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:14.473450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:14.474131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:14.474418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:14.474696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:14.482971 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:14.484551 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9785359-4f38-45cb-8292-1731da750647 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:14.494139 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 488/989] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:16.797369 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed3ac-aa12-49fc-a6a0-052070de126d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:16.798427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed3ac-aa12-49fc-a6a0-052070de126d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:16.798914 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed3ac-aa12-49fc-a6a0-052070de126d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:16.800788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 502/990] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:16.806539 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb5a6-d48d-45e9-bd38-c61f253465b7 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:16.807351 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb5a6-d48d-45e9-bd38-c61f253465b7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:16.807810 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb5a6-d48d-45e9-bd38-c61f253465b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:16.827680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-4efdb5a6-d48d-45e9-bd38-c61f253465b7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:16.829128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4efdb5a6-d48d-45e9-bd38-c61f253465b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:16.837652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 489/991] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:16.885940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed3ac-aa12-49fc-a6a0-052070de126d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:16.901513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed3ac-aa12-49fc-a6a0-052070de126d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:16.907631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:16.908600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:16.909034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:16.909461 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:16.918755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:16.921663 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7f01-f588-4916-95f6-11ce21f6e075 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:16.944565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 503/992] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:18.812359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a58e-dabf-4e0c-8e9e-780f0072438f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:18.812823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a58e-dabf-4e0c-8e9e-780f0072438f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:18.812924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a58e-dabf-4e0c-8e9e-780f0072438f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:18.820051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d363952-de67-4c85-9961-d429eff954e0 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:18.820949 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d363952-de67-4c85-9961-d429eff954e0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:18.821730 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d363952-de67-4c85-9961-d429eff954e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:18.824335 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 490/993] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:18.854532 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-1d363952-de67-4c85-9961-d429eff954e0 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:18.857443 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-1d363952-de67-4c85-9961-d429eff954e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:18.884592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 504/994] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:19.323012 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fc7d-376b-4179-b2b2-7fdbcad92d9a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.323283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fc7d-376b-4179-b2b2-7fdbcad92d9a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.323761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fc7d-376b-4179-b2b2-7fdbcad92d9a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.325530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 491/995] 10.222.0.17 () {54 vars in 963 bytes} [Fri Jul 15 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:19.331385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.331683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.331951 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.370172 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] MFA Rules not processed for user `c0e23da86db744f88719c5511226d9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:19.371378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:19.378546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb9ad-fc9b-470e-bac8-6eefdcf67394 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.379075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb9ad-fc9b-470e-bac8-6eefdcf67394 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.379514 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb9ad-fc9b-470e-bac8-6eefdcf67394 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.381322 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 492/996] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:49:19.386654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.387223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.387708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.407468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:19.408667 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:19.416690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 493/997] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:19.443884 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 505/998] 10.222.0.17 () {58 vars in 1060 bytes} [Fri Jul 15 21:49:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:19.454910 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:19.463024 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:19.464762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ffb44-04e8-4444-aa42-7a1072b2257c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:19.468486 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e23da86db744f88719c5511226d9a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:19.469147 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.469557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.469833 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.475590 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e6b39-ef99-4bda-b7fe-1ced8d4fee6d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:19.480430 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:19.480649 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:19.481355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:19.481895 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:19.482040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f157f-8548-4109-aa64-98506b76d47c service cinder] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:19.482376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:19.491314 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:19.492759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 494/999] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:19.492982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76551a-cbd2-4d8c-a12f-3321c051d91e service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:19.498532 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:19.506684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 506/1000] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:49:21.821803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc81b-e03d-4983-b580-93ef2f77e916 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:21.822309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc81b-e03d-4983-b580-93ef2f77e916 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:21.822416 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc81b-e03d-4983-b580-93ef2f77e916 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:21.824012 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 495/1001] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:21.829362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2dcae-26d9-4bd9-a8e4-c2960053e1ce None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:21.829841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2dcae-26d9-4bd9-a8e4-c2960053e1ce None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:21.830003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2dcae-26d9-4bd9-a8e4-c2960053e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:21.848932 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-bcd2dcae-26d9-4bd9-a8e4-c2960053e1ce None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:21.850166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-bcd2dcae-26d9-4bd9-a8e4-c2960053e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:21.859354 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 507/1002] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:21.906531 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc81b-e03d-4983-b580-93ef2f77e916 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:21.920961 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc81b-e03d-4983-b580-93ef2f77e916 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:21.927008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:21.927674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:21.927989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:21.928266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:21.938730 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:21.940364 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a53e12-0cc9-44cc-bd18-0f2dd6d3f19e service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:21.953060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 496/1003] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:24.199677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53895-82d2-4b30-83ed-ba3c633ff2f1 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:24.200992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53895-82d2-4b30-83ed-ba3c633ff2f1 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:24.201292 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53895-82d2-4b30-83ed-ba3c633ff2f1 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:24.202714 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 508/1004] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:24.208564 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b33-7822-41f7-8bfe-90d64b028aac None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:24.209413 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b33-7822-41f7-8bfe-90d64b028aac None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:24.209698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b33-7822-41f7-8bfe-90d64b028aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:24.229069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e7e00b33-7822-41f7-8bfe-90d64b028aac None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:24.230300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e7e00b33-7822-41f7-8bfe-90d64b028aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:24.241904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 497/1005] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:24.285228 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53895-82d2-4b30-83ed-ba3c633ff2f1 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:24.298936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53895-82d2-4b30-83ed-ba3c633ff2f1 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:24.303729 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:24.304373 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:24.304654 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:24.304928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:24.313597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:24.315226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfc13e-2377-4adc-aa0e-057d3c3ab73d service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:24.324817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 509/1006] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:26.592342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d6c-1eb0-461b-a6c5-7a89ddd8924b None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:26.593973 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d6c-1eb0-461b-a6c5-7a89ddd8924b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:26.594257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d6c-1eb0-461b-a6c5-7a89ddd8924b None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:26.596040 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 498/1007] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:26.603077 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6b15-a3c3-4a40-988a-d7ddb4702f6e None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:26.604383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6b15-a3c3-4a40-988a-d7ddb4702f6e None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:26.605251 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6b15-a3c3-4a40-988a-d7ddb4702f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:26.627511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-1fff6b15-a3c3-4a40-988a-d7ddb4702f6e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:26.628840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-1fff6b15-a3c3-4a40-988a-d7ddb4702f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:26.636996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 510/1008] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:26.694146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21d6c-1eb0-461b-a6c5-7a89ddd8924b None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:26.711148 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21d6c-1eb0-461b-a6c5-7a89ddd8924b None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:26.718703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:26.719886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:26.720354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:26.720797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:26.733038 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:26.734701 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc065ec-fe79-4652-a0e2-2a2eaf98ca67 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:26.745162 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 499/1009] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:29.153021 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782d4-fd0c-4b48-932b-5a4adb57ee4a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:29.154097 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782d4-fd0c-4b48-932b-5a4adb57ee4a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:29.154662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782d4-fd0c-4b48-932b-5a4adb57ee4a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:29.156283 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 511/1010] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:29.163599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b888-8e42-42f5-ac97-e95164fe7c60 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:29.164330 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b888-8e42-42f5-ac97-e95164fe7c60 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:29.164521 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b888-8e42-42f5-ac97-e95164fe7c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:29.185212 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-1421b888-8e42-42f5-ac97-e95164fe7c60 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:29.186615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-1421b888-8e42-42f5-ac97-e95164fe7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:29.196387 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 500/1011] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:29.252750 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0782d4-fd0c-4b48-932b-5a4adb57ee4a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:29.271882 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0782d4-fd0c-4b48-932b-5a4adb57ee4a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:29.279925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:29.280847 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:29.281235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:29.281652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:29.296421 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:29.298694 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc6b75-835d-4ea0-ba65-1694bcf78f59 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:29.318412 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 512/1012] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:32.558114 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e1c7-252e-4d22-a587-91e7276da5df None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:32.558783 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e1c7-252e-4d22-a587-91e7276da5df None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:32.558783 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e1c7-252e-4d22-a587-91e7276da5df None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:32.560206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 501/1013] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:32.567448 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d2df-9fd5-4bca-bd18-3745793157ec None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:32.568083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d2df-9fd5-4bca-bd18-3745793157ec None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:32.568083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d2df-9fd5-4bca-bd18-3745793157ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:32.595003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-fa47d2df-9fd5-4bca-bd18-3745793157ec None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:32.596352 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-fa47d2df-9fd5-4bca-bd18-3745793157ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:32.605791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 513/1014] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:32.662775 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0e1c7-252e-4d22-a587-91e7276da5df None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:32.683377 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0e1c7-252e-4d22-a587-91e7276da5df None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:32.691076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:32.691785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:32.692084 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:32.692376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:32.702523 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:32.704232 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098502b-75a0-4cd8-b2a6-dc0ce6f4054c service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:32.714321 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 502/1015] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:35.503254 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ffb2-fb29-4500-9c76-5444ad05567c None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.504001 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ffb2-fb29-4500-9c76-5444ad05567c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.504001 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ffb2-fb29-4500-9c76-5444ad05567c None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.505417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 514/1016] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:35.510227 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.510509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.510642 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab75-e47d-408e-9270-33795d573ab6 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.511082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.511176 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab75-e47d-408e-9270-33795d573ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.511176 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab75-e47d-408e-9270-33795d573ab6 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.512644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 503/1017] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:35.517714 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0dda-4ebb-4fd6-9c5b-4c1bbdeecdf5 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.517904 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0dda-4ebb-4fd6-9c5b-4c1bbdeecdf5 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.518092 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0dda-4ebb-4fd6-9c5b-4c1bbdeecdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.524475 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=52 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:35.532210 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:35.533431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:35.538332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-261b0dda-4ebb-4fd6-9c5b-4c1bbdeecdf5 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:35.539494 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-261b0dda-4ebb-4fd6-9c5b-4c1bbdeecdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:35.542116 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 515/1018] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:35.547921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 504/1019] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:35.592359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:35.599146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e43-8bb6-4ae7-be48-6d500771b57c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.599432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e43-8bb6-4ae7-be48-6d500771b57c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.599708 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e43-8bb6-4ae7-be48-6d500771b57c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.601244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 505/1020] 10.222.0.17 () {54 vars in 960 bytes} [Fri Jul 15 21:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:49:35.605256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34706076-55d8-49db-b1ac-94c0a310a982 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:35.605901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ba67-997b-4903-aaae-767dd5a01f1e None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.606220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ba67-997b-4903-aaae-767dd5a01f1e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.606534 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ba67-997b-4903-aaae-767dd5a01f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.611224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:35.611894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.612179 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.612452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.621225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:35.623274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:35.632879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 516/1021] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:49:35.642697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-b8a8ba67-997b-4903-aaae-767dd5a01f1e None None] MFA Rules not processed for user `d66fa72ed4554daaa34a0fe6f5d6f8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:35.643802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b8a8ba67-997b-4903-aaae-767dd5a01f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:35.707282 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 506/1022] 10.222.0.17 () {58 vars in 1057 bytes} [Fri Jul 15 21:49:35 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:49:35.715101 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:35.725280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98301ac-49ea-49c9-aad0-996cb25d3357 service nova] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:35.729298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fa72ed4554daaa34a0fe6f5d6f8ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:35.729994 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:35.730272 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:35.730544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:35.741123 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:35.742622 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2087-1f7b-4394-9ef0-816d4637e41d service glance] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:35.753309 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 517/1023] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:37.932002 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836d40-7004-4441-b732-5f738cbded6d None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:37.933046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836d40-7004-4441-b732-5f738cbded6d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:37.933046 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836d40-7004-4441-b732-5f738cbded6d None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:37.934661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 507/1024] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:37.941422 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9080-baae-4456-84c6-3fe0471f7db5 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:37.942076 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9080-baae-4456-84c6-3fe0471f7db5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:37.942076 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9080-baae-4456-84c6-3fe0471f7db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:37.961284 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2ffc9080-baae-4456-84c6-3fe0471f7db5 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:37.962610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2ffc9080-baae-4456-84c6-3fe0471f7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:37.971681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 518/1025] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:49:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:38.019578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d836d40-7004-4441-b732-5f738cbded6d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:38.036004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d836d40-7004-4441-b732-5f738cbded6d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:38.041426 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:38.042131 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:38.042419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:38.042700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:38.053930 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:38.055563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb863b69-2be0-4487-849e-e831e90a19d1 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:38.066596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 508/1026] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:47.955725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=40 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:48.061754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=41 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:49:50.983975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80209-96b8-4b30-8e15-592a624b9156 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:50.984629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80209-96b8-4b30-8e15-592a624b9156 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:50.984629 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf80209-96b8-4b30-8e15-592a624b9156 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:50.985907 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 519/1027] 10.222.0.17 () {54 vars in 918 bytes} [Fri Jul 15 21:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:50.994313 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a602-7f21-49c4-8101-5cd2cbef83cd None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:50.994811 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a602-7f21-49c4-8101-5cd2cbef83cd None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:50.994909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a602-7f21-49c4-8101-5cd2cbef83cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:51.015127 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-9468a602-7f21-49c4-8101-5cd2cbef83cd None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:51.016389 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-9468a602-7f21-49c4-8101-5cd2cbef83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:51.029821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 509/1028] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Jul 15 21:49:50 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:51.050889 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98a90-21a5-415c-8792-634fc9a20d3d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:51.051182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98a90-21a5-415c-8792-634fc9a20d3d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:51.051465 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98a90-21a5-415c-8792-634fc9a20d3d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:51.052861 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 520/1029] 10.222.0.17 () {54 vars in 918 bytes} [Fri Jul 15 21:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:51.057599 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6915-0ca9-4949-9f35-a201a78fa2b2 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:51.057938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6915-0ca9-4949-9f35-a201a78fa2b2 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:51.058248 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6915-0ca9-4949-9f35-a201a78fa2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:51.077530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-af6b6915-0ca9-4949-9f35-a201a78fa2b2 None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:51.078762 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-af6b6915-0ca9-4949-9f35-a201a78fa2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:51.088194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 510/1030] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Jul 15 21:49:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:53.831417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0a70-8d33-4472-9766-645bcd89ef2a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:53.832056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0a70-8d33-4472-9766-645bcd89ef2a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:53.832056 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0a70-8d33-4472-9766-645bcd89ef2a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:53.833351 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 521/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:53.838824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e317-8406-4566-9f66-6c864e4a9cec None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:53.839226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e317-8406-4566-9f66-6c864e4a9cec None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:53.839414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e317-8406-4566-9f66-6c864e4a9cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:53.859238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-21e8e317-8406-4566-9f66-6c864e4a9cec None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:53.860419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-21e8e317-8406-4566-9f66-6c864e4a9cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:53.868851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 511/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:49:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:53.916360 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0a70-8d33-4472-9766-645bcd89ef2a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:53.933788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0a70-8d33-4472-9766-645bcd89ef2a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:53.940678 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:53.941353 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:53.941635 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:53.941928 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:53.950823 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:53.952427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cecd5-7129-40b6-8c00-51c1628d8b3c service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:53.962098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 522/1033] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:54.900823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2a8b-aeca-4e73-b46d-ce6dcddf4f6f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:54.901922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2a8b-aeca-4e73-b46d-ce6dcddf4f6f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:54.901922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2a8b-aeca-4e73-b46d-ce6dcddf4f6f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:54.904506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 512/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:49:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:54.912938 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63508b-3b7f-40a5-8170-93c791d4d444 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:54.913661 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63508b-3b7f-40a5-8170-93c791d4d444 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:54.913913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63508b-3b7f-40a5-8170-93c791d4d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:54.935163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-0a63508b-3b7f-40a5-8170-93c791d4d444 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:54.936390 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-0a63508b-3b7f-40a5-8170-93c791d4d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:54.944814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 523/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:49:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:55.154306 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd2a8b-aeca-4e73-b46d-ce6dcddf4f6f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:55.172989 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd2a8b-aeca-4e73-b46d-ce6dcddf4f6f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:55.181907 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:55.182859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:55.183224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:55.183648 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:55.192717 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:55.194362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958b64-d18d-428d-b223-a3c8f50d313b service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:55.204533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 513/1036] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:56.096673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00161-4883-4db4-b152-75a1cfba3cab None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:56.097233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00161-4883-4db4-b152-75a1cfba3cab None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:56.097233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00161-4883-4db4-b152-75a1cfba3cab None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:56.098592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 524/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:56.104638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48dd9-761b-4edd-a1e7-a56125476b56 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:56.105443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48dd9-761b-4edd-a1e7-a56125476b56 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:56.105607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48dd9-761b-4edd-a1e7-a56125476b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:56.127977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-9ef48dd9-761b-4edd-a1e7-a56125476b56 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:56.129169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-9ef48dd9-761b-4edd-a1e7-a56125476b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:56.138546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 514/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:49:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:56.296733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac00161-4883-4db4-b152-75a1cfba3cab None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:56.311532 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac00161-4883-4db4-b152-75a1cfba3cab None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:56.317423 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:56.318088 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:56.318366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:56.318640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:56.327190 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:56.328778 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28517-6e8d-4df8-b04a-1a60bac7d432 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:56.338391 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 525/1039] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:49:57.211343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f8a-1fea-43c4-8c6e-8c49dbc36a41 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:57.212004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f8a-1fea-43c4-8c6e-8c49dbc36a41 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:57.212004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204f8a-1fea-43c4-8c6e-8c49dbc36a41 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:57.213361 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 515/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:57.218387 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638357b9-bf1d-4ec2-be28-9bb5a57687fc None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:57.218839 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638357b9-bf1d-4ec2-be28-9bb5a57687fc None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:57.218936 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638357b9-bf1d-4ec2-be28-9bb5a57687fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:57.237425 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-638357b9-bf1d-4ec2-be28-9bb5a57687fc None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:57.238644 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-638357b9-bf1d-4ec2-be28-9bb5a57687fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:57.246925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 526/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:49:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:57.403020 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204f8a-1fea-43c4-8c6e-8c49dbc36a41 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:57.420984 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204f8a-1fea-43c4-8c6e-8c49dbc36a41 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:57.427233 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:57.427873 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:57.428160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:57.428439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:57.437167 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:57.438797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbd95-29eb-4572-a677-15395b2effa6 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:57.448555 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 516/1042] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:58.325613 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d6ca-2889-4e86-945c-e064583e3292 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:58.326259 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d6ca-2889-4e86-945c-e064583e3292 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:58.326430 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d6ca-2889-4e86-945c-e064583e3292 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:58.328650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 527/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:49:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:58.337050 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79214-2533-4697-9b57-7bc88bbb294b None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:58.337457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79214-2533-4697-9b57-7bc88bbb294b None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:58.337680 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79214-2533-4697-9b57-7bc88bbb294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:58.358725 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-c8c79214-2533-4697-9b57-7bc88bbb294b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:58.359939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c8c79214-2533-4697-9b57-7bc88bbb294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:58.369440 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 517/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:49:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:58.535783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d6ca-2889-4e86-945c-e064583e3292 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:58.553489 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d6ca-2889-4e86-945c-e064583e3292 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:58.559744 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:58.560246 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:58.560524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:58.560796 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:58.570033 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:58.571641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b647e-d8de-4f58-9f23-093fbc270c96 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:58.581525 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 528/1045] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:49:59.382689 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba8d52-495b-4262-bcc4-3a1911fec0a0 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:59.383309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba8d52-495b-4262-bcc4-3a1911fec0a0 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:59.383309 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba8d52-495b-4262-bcc4-3a1911fec0a0 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:59.384622 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 518/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:49:59.389922 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcbf39-850d-4ca0-85fa-f1c08a9afc08 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:59.390401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcbf39-850d-4ca0-85fa-f1c08a9afc08 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:59.390515 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcbf39-850d-4ca0-85fa-f1c08a9afc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:59.418319 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-50dcbf39-850d-4ca0-85fa-f1c08a9afc08 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:49:59.419980 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-50dcbf39-850d-4ca0-85fa-f1c08a9afc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:49:59.429429 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 529/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:49:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:49:59.592977 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba8d52-495b-4262-bcc4-3a1911fec0a0 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:49:59.608586 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba8d52-495b-4262-bcc4-3a1911fec0a0 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:49:59.614005 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:49:59.614645 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:49:59.614923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:49:59.615194 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:49:59.623607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:49:59.625181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5964135-b256-49d0-b2f6-d8fa3b9bcb79 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:49:59.634765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 519/1048] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:49:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:00.459269 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d0f9-fa64-4f7f-abc4-cb1dbb6e5fae None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:00.459820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d0f9-fa64-4f7f-abc4-cb1dbb6e5fae None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:00.459820 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d0f9-fa64-4f7f-abc4-cb1dbb6e5fae None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:00.461939 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 530/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:50:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:00.469491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf8e-71a4-4715-8a8e-cb3f3a7414e7 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:00.470243 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf8e-71a4-4715-8a8e-cb3f3a7414e7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:00.470352 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffcf8e-71a4-4715-8a8e-cb3f3a7414e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:00.498862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-78ffcf8e-71a4-4715-8a8e-cb3f3a7414e7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:00.500074 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-78ffcf8e-71a4-4715-8a8e-cb3f3a7414e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:00.508463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 520/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:50:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:00.661058 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d0f9-fa64-4f7f-abc4-cb1dbb6e5fae None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:00.684166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d0f9-fa64-4f7f-abc4-cb1dbb6e5fae None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:00.691120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:00.691761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:00.692046 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:00.692320 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:00.701034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:00.702745 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9cd36-2930-4c71-88fe-c7f5117fd036 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:00.712493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 531/1051] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:01.538242 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c1fe-3f1f-4c62-94f1-c5aaf0628c60 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:01.538812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c1fe-3f1f-4c62-94f1-c5aaf0628c60 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:01.538812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c1fe-3f1f-4c62-94f1-c5aaf0628c60 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:01.540208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 521/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:01.546925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2fa2-ae08-492b-ab25-76d79a55fd8c None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:01.547686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2fa2-ae08-492b-ab25-76d79a55fd8c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:01.547821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2fa2-ae08-492b-ab25-76d79a55fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:01.577821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-e41c2fa2-ae08-492b-ab25-76d79a55fd8c None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:01.579063 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-e41c2fa2-ae08-492b-ab25-76d79a55fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:01.587584 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 532/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:50:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:01.752229 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c1fe-3f1f-4c62-94f1-c5aaf0628c60 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:01.772223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c1fe-3f1f-4c62-94f1-c5aaf0628c60 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:01.777993 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:01.779037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:01.779341 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:01.779592 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:01.788027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:01.789605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389f24b-5fbb-4d6f-a2bc-1ef1d8de4bf3 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:01.799524 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 522/1054] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:02.614807 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064171-831d-4a94-9250-03e4ecca072b None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:02.615782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064171-831d-4a94-9250-03e4ecca072b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:02.615782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064171-831d-4a94-9250-03e4ecca072b None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:02.617996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 533/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:02.626533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f4f2-9a02-457e-9516-d49d5a086173 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:02.627031 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f4f2-9a02-457e-9516-d49d5a086173 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:02.627139 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f4f2-9a02-457e-9516-d49d5a086173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:02.648926 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-8af4f4f2-9a02-457e-9516-d49d5a086173 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:02.650381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-8af4f4f2-9a02-457e-9516-d49d5a086173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:02.661238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 523/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:50:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:02.826413 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064171-831d-4a94-9250-03e4ecca072b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:02.842149 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064171-831d-4a94-9250-03e4ecca072b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:02.847619 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:02.848258 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:02.848541 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:02.848800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:02.857274 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:02.858992 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe6119-40b2-4801-8242-a7babaaedfa5 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:02.869028 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 534/1057] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:04.954210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d991-dcf9-4595-bc92-eb038c9df484 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:04.954824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d991-dcf9-4595-bc92-eb038c9df484 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:04.954824 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d991-dcf9-4595-bc92-eb038c9df484 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:04.956157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 524/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:04.965034 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d48-031a-4749-b216-b23918f6005f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:04.965511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d48-031a-4749-b216-b23918f6005f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:04.965614 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d48-031a-4749-b216-b23918f6005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:04.983700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2b346d48-031a-4749-b216-b23918f6005f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:04.984890 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2b346d48-031a-4749-b216-b23918f6005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:04.992975 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 535/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:05.038554 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35d991-dcf9-4595-bc92-eb038c9df484 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:05.057467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35d991-dcf9-4595-bc92-eb038c9df484 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:05.063646 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:05.064295 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:05.064576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:05.064848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:05.075226 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:05.076841 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6de786-939a-4549-ad53-8ca1d37320fd service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:05.086773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 525/1060] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:07.509657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae062b3-7021-4ca0-ba88-85d2a4109f92 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:07.510616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae062b3-7021-4ca0-ba88-85d2a4109f92 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:07.510616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae062b3-7021-4ca0-ba88-85d2a4109f92 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:07.513120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 536/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:07.518776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee23f-29e4-4654-b107-dc2865f109e7 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:07.519255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee23f-29e4-4654-b107-dc2865f109e7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:07.519357 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee23f-29e4-4654-b107-dc2865f109e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:07.546517 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-541ee23f-29e4-4654-b107-dc2865f109e7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:07.547765 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-541ee23f-29e4-4654-b107-dc2865f109e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:07.557252 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 526/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:07.600836 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae062b3-7021-4ca0-ba88-85d2a4109f92 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:07.615306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae062b3-7021-4ca0-ba88-85d2a4109f92 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:07.619514 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:07.620156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:07.620438 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:07.620712 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:07.631540 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:07.632987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c96d85-5acf-41ea-9b1a-c434c1356af0 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:07.643388 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 537/1063] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:10.272839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c962f6-6599-4343-b286-9f7ded631f0c None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:10.273447 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c962f6-6599-4343-b286-9f7ded631f0c None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:10.273447 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c962f6-6599-4343-b286-9f7ded631f0c None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:10.275899 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 527/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:10.282233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f221-f62a-483c-8f59-0a0d69142c17 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:10.282733 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f221-f62a-483c-8f59-0a0d69142c17 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:10.282977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f221-f62a-483c-8f59-0a0d69142c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:10.302756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-fb52f221-f62a-483c-8f59-0a0d69142c17 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:10.303947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-fb52f221-f62a-483c-8f59-0a0d69142c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:10.312409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 538/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:10.355703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c962f6-6599-4343-b286-9f7ded631f0c None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:10.374026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c962f6-6599-4343-b286-9f7ded631f0c None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:10.377890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:10.378562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:10.378848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:10.379120 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:10.388886 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:10.390376 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d4c43-a8e1-42b6-b483-56505fa2d765 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:10.400660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 528/1066] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:12.745496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c4e2-ef08-4ca6-bb54-785faf23baaf None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:12.746090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c4e2-ef08-4ca6-bb54-785faf23baaf None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:12.746090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c4e2-ef08-4ca6-bb54-785faf23baaf None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:12.747472 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 539/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:12.753823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89e88-bf3a-4fcd-ac8b-dfd4855d7dad None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:12.754283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89e88-bf3a-4fcd-ac8b-dfd4855d7dad None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:12.754484 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89e88-bf3a-4fcd-ac8b-dfd4855d7dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:12.777113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-f8f89e88-bf3a-4fcd-ac8b-dfd4855d7dad None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:12.778340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-f8f89e88-bf3a-4fcd-ac8b-dfd4855d7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:12.787112 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 529/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:12.829026 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c4e2-ef08-4ca6-bb54-785faf23baaf None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:12.848399 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c4e2-ef08-4ca6-bb54-785faf23baaf None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:12.855371 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:12.856383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:12.856832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:12.857345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:12.867186 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:12.868630 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123307-0230-41b3-8f76-029faab60e81 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:12.878240 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 540/1069] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:15.151821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef09d-5a38-4fdd-a113-8b81a436fcdf None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:15.152381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef09d-5a38-4fdd-a113-8b81a436fcdf None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:15.152381 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef09d-5a38-4fdd-a113-8b81a436fcdf None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:15.154104 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 530/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:50:15.160817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c031-9e63-46ed-b26f-10bf412c3dd5 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:15.161270 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c031-9e63-46ed-b26f-10bf412c3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:15.161396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c031-9e63-46ed-b26f-10bf412c3dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:15.184024 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2ec6c031-9e63-46ed-b26f-10bf412c3dd5 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:15.185219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2ec6c031-9e63-46ed-b26f-10bf412c3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:15.194904 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 541/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:15.236274 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef09d-5a38-4fdd-a113-8b81a436fcdf None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:15.249429 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef09d-5a38-4fdd-a113-8b81a436fcdf None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:15.253684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:15.254358 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:15.254635 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:15.254911 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:15.265389 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:15.266905 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01583a-d401-4b90-b906-8893c481b5a0 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:15.276803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 531/1072] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:17.641191 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe91c1-3846-4e0f-ba7c-63a89dd5f419 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:17.641800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe91c1-3846-4e0f-ba7c-63a89dd5f419 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:17.641800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe91c1-3846-4e0f-ba7c-63a89dd5f419 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:17.643174 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 542/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:17.650459 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee1d-a7d4-459a-b4fb-ec3f1abd8830 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:17.651206 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee1d-a7d4-459a-b4fb-ec3f1abd8830 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:17.651386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee1d-a7d4-459a-b4fb-ec3f1abd8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:17.672706 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-2492ee1d-a7d4-459a-b4fb-ec3f1abd8830 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:17.673968 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-2492ee1d-a7d4-459a-b4fb-ec3f1abd8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:17.682619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 532/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:17.721078 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe91c1-3846-4e0f-ba7c-63a89dd5f419 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:17.733641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe91c1-3846-4e0f-ba7c-63a89dd5f419 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:17.738036 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:17.738673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:17.738948 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:17.739221 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:17.748913 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:17.750400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175f167-a37b-47a4-8b72-e4eb010311f2 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:17.760500 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 543/1075] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:20.054132 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4087d-9afd-4e4f-beb9-5bb67daf979a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:20.054768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4087d-9afd-4e4f-beb9-5bb67daf979a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:20.054768 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4087d-9afd-4e4f-beb9-5bb67daf979a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:20.056065 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 533/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:20.064395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b54a4-53b7-4a3e-aeda-5bf01e649e51 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:20.065137 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b54a4-53b7-4a3e-aeda-5bf01e649e51 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:20.065333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b54a4-53b7-4a3e-aeda-5bf01e649e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:20.076084 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=70 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:50:20.095628 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-1c9b54a4-53b7-4a3e-aeda-5bf01e649e51 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:20.097356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-1c9b54a4-53b7-4a3e-aeda-5bf01e649e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:20.106908 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 544/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:20.149079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4087d-9afd-4e4f-beb9-5bb67daf979a None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:20.157299 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=73 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:50:20.163906 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4087d-9afd-4e4f-beb9-5bb67daf979a None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:20.167670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:20.168313 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:20.168580 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:20.168852 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:20.178577 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:20.180073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70bc2c-6462-4cf3-9ba2-0188f8003fcc service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:20.190237 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 534/1078] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:22.466706 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ed00d-58cb-4fc9-9c9d-e1117a44abf6 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:22.467293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ed00d-58cb-4fc9-9c9d-e1117a44abf6 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:22.467673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ed00d-58cb-4fc9-9c9d-e1117a44abf6 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:22.469937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 545/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:22.477901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13293-f255-4f23-b548-8926bd84739f None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:22.478390 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13293-f255-4f23-b548-8926bd84739f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:22.478488 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13293-f255-4f23-b548-8926bd84739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:22.496849 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-d2d13293-f255-4f23-b548-8926bd84739f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:22.498074 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d2d13293-f255-4f23-b548-8926bd84739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:22.506377 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 535/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:50:22.547499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ed00d-58cb-4fc9-9c9d-e1117a44abf6 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:22.561083 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ed00d-58cb-4fc9-9c9d-e1117a44abf6 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:22.565459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:22.566135 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:22.566427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:22.566702 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:22.577080 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:22.578570 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dadafd-9209-443d-8c02-7f49b9f49b88 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:22.588377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 546/1081] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:24.880300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e40-5788-446f-bdee-adeedcc7974f None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:24.881185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e40-5788-446f-bdee-adeedcc7974f None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:24.881185 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e40-5788-446f-bdee-adeedcc7974f None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:24.883468 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 536/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:24.889656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98f29-46b3-405a-a998-4d6d94948051 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:24.890165 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98f29-46b3-405a-a998-4d6d94948051 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:24.890268 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98f29-46b3-405a-a998-4d6d94948051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:24.908984 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-bcb98f29-46b3-405a-a998-4d6d94948051 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:24.910220 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-bcb98f29-46b3-405a-a998-4d6d94948051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:24.918840 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 547/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:24.960777 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6e40-5788-446f-bdee-adeedcc7974f None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:24.979751 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6e40-5788-446f-bdee-adeedcc7974f None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:24.984845 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:24.985483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:24.985773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:24.986079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:24.995695 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:24.997235 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e15d-a384-4fe8-892f-b2734149a7e5 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:25.006964 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 537/1084] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:27.250428 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108af4-b2ba-4520-8042-97bb547e32e0 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:27.251400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108af4-b2ba-4520-8042-97bb547e32e0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:27.251400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108af4-b2ba-4520-8042-97bb547e32e0 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:27.253557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 548/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:50:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:27.259073 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfa4e-fa4d-440c-ab32-3a95803a296e None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:27.259532 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfa4e-fa4d-440c-ab32-3a95803a296e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:27.259638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfa4e-fa4d-440c-ab32-3a95803a296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:27.279592 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-ba8bfa4e-fa4d-440c-ab32-3a95803a296e None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:27.280785 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-ba8bfa4e-fa4d-440c-ab32-3a95803a296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:27.289415 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 538/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:50:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:27.328841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2108af4-b2ba-4520-8042-97bb547e32e0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:27.342040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2108af4-b2ba-4520-8042-97bb547e32e0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:27.346293 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:27.346924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:27.347202 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:27.347471 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:27.357543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:27.359005 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf3a19-e346-4f8e-8c46-45e13b5ee0b5 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:27.368409 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 549/1087] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:37.273574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=17 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:50:37.364238 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=17 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:50:50.808163 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90ed0-528f-482a-9b89-d690d5605f00 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:50.808778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90ed0-528f-482a-9b89-d690d5605f00 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:50.808778 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90ed0-528f-482a-9b89-d690d5605f00 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:50.810296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 539/1088] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:50.816039 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b6d-b01e-494d-ae8c-19e817bb26fc None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:50.816522 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b6d-b01e-494d-ae8c-19e817bb26fc None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:50.816624 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207b6d-b01e-494d-ae8c-19e817bb26fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:50.842559 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-6f207b6d-b01e-494d-ae8c-19e817bb26fc None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:50.843751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-6f207b6d-b01e-494d-ae8c-19e817bb26fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:50.858193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 550/1089] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:50:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:50.908936 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2fb4-d9b3-47d4-83a0-0c877eaf561e None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:50.909225 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2fb4-d9b3-47d4-83a0-0c877eaf561e None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:50.909547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e2fb4-d9b3-47d4-83a0-0c877eaf561e None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:50.911650 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 540/1090] 10.222.0.17 () {54 vars in 960 bytes} [Fri Jul 15 21:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:50.917040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c548-b29a-427b-9b26-aad5c6f6017f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:50.917332 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c548-b29a-427b-9b26-aad5c6f6017f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:50.917616 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c548-b29a-427b-9b26-aad5c6f6017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:50.937451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-19d8c548-b29a-427b-9b26-aad5c6f6017f None None] MFA Rules not processed for user `d66fa72ed4554daaa34a0fe6f5d6f8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:50.938687 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-19d8c548-b29a-427b-9b26-aad5c6f6017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:50.945556 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 551/1091] 10.222.0.17 () {58 vars in 1057 bytes} [Fri Jul 15 21:50:50 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:50.953270 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e2fb4-d9b3-47d4-83a0-0c877eaf561e None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:50.965478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e2fb4-d9b3-47d4-83a0-0c877eaf561e None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:50.970629 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fa72ed4554daaa34a0fe6f5d6f8ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:50.971275 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:50.971556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:50.971829 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:50.982703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:50.984128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8696b-cd39-4fc8-a307-0957793af8f8 service glance] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:50.993769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 541/1092] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:53.351872 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4ef5-6a95-434b-97e6-d04af892ad21 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:53.352498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4ef5-6a95-434b-97e6-d04af892ad21 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:53.352498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4ef5-6a95-434b-97e6-d04af892ad21 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:53.354639 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 552/1093] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:53.362179 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1929e-22a7-4293-978e-f8c04c17df12 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:53.362796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1929e-22a7-4293-978e-f8c04c17df12 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:53.362796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1929e-22a7-4293-978e-f8c04c17df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:53.388603 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5dd1929e-22a7-4293-978e-f8c04c17df12 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:53.389848 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5dd1929e-22a7-4293-978e-f8c04c17df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:53.400186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 542/1094] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:50:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:53.432535 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff4ef5-6a95-434b-97e6-d04af892ad21 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:53.453253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff4ef5-6a95-434b-97e6-d04af892ad21 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:53.459235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:53.460869 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:53.461156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:53.461434 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:53.462213 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:53.464287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:50:53.464287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:50:53.464287 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:50:53.465529 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e3320-2771-4e7b-ac57-23b3d62f5898 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:53.492032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 553/1095] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Jul 15 21:50:53 2022] GET /identity/v3/projects => generated 1606 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:50:55.798788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71c06-b469-4004-9e17-f55a2a7d07b6 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:55.799666 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71c06-b469-4004-9e17-f55a2a7d07b6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:55.799666 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71c06-b469-4004-9e17-f55a2a7d07b6 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:55.801932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 543/1096] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:50:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:55.810726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187710f4-1d97-443d-8c30-8376d1dd4729 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:55.811476 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187710f4-1d97-443d-8c30-8376d1dd4729 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:55.811828 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187710f4-1d97-443d-8c30-8376d1dd4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:55.836102 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-187710f4-1d97-443d-8c30-8376d1dd4729 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:55.837306 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-187710f4-1d97-443d-8c30-8376d1dd4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:55.846814 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 554/1097] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:50:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:55.891812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb71c06-b469-4004-9e17-f55a2a7d07b6 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:55.908431 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb71c06-b469-4004-9e17-f55a2a7d07b6 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:55.913463 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093932c-2be2-4464-b626-8025632405bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:55.914154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093932c-2be2-4464-b626-8025632405bb service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:55.914433 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093932c-2be2-4464-b626-8025632405bb service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:55.914705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093932c-2be2-4464-b626-8025632405bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:55.923076 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093932c-2be2-4464-b626-8025632405bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:55.924660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093932c-2be2-4464-b626-8025632405bb service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:55.934061 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 544/1098] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:50:58.346379 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68bc3-b65a-4b5d-ac37-63e742f6b686 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:58.346981 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68bc3-b65a-4b5d-ac37-63e742f6b686 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:58.346981 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68bc3-b65a-4b5d-ac37-63e742f6b686 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:58.348336 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 555/1099] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:50:58.357183 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e68d-845d-42e2-993d-ba09572dd5d2 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:58.358458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e68d-845d-42e2-993d-ba09572dd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:58.358956 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e68d-845d-42e2-993d-ba09572dd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:58.386102 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-0e52e68d-845d-42e2-993d-ba09572dd5d2 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:50:58.387304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-0e52e68d-845d-42e2-993d-ba09572dd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:50:58.396208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 545/1100] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:50:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:50:58.437057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68bc3-b65a-4b5d-ac37-63e742f6b686 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:50:58.456355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68bc3-b65a-4b5d-ac37-63e742f6b686 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:50:58.463482 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:50:58.464395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:50:58.464738 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:50:58.465069 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:50:58.475505 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:50:58.476950 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfa06c-7c3b-4e9e-b798-d5b68efd57dc service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:50:58.486700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 556/1101] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:50:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:51:00.793412 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022173-a825-4134-b674-ea9c4da198c8 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:00.794697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022173-a825-4134-b674-ea9c4da198c8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:00.794697 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022173-a825-4134-b674-ea9c4da198c8 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:00.796574 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 546/1102] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:51:00.805420 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3852-1b13-4e78-8f3c-9e57bda4221b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:00.806176 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3852-1b13-4e78-8f3c-9e57bda4221b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:00.806446 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3852-1b13-4e78-8f3c-9e57bda4221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:00.833758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-efff3852-1b13-4e78-8f3c-9e57bda4221b None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:51:00.835000 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-efff3852-1b13-4e78-8f3c-9e57bda4221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:51:00.843906 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 557/1103] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:51:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:51:00.884911 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022173-a825-4134-b674-ea9c4da198c8 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:51:00.897257 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022173-a825-4134-b674-ea9c4da198c8 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:51:00.900970 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:51:00.901605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:00.901932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:00.902217 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:00.912455 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:51:00.913924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f90bf-2496-424e-a82a-bacb294bfed7 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:51:00.924562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 547/1104] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:51:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:51:03.370167 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caabc68-2333-4183-812e-b504f24fc995 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:03.371031 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caabc68-2333-4183-812e-b504f24fc995 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:03.371253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caabc68-2333-4183-812e-b504f24fc995 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:03.373160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 558/1105] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:51:03.378872 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b593a-140e-4c01-acfe-0d416f73afde None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:03.379346 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b593a-140e-4c01-acfe-0d416f73afde None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:03.379442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b593a-140e-4c01-acfe-0d416f73afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:03.398390 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-774b593a-140e-4c01-acfe-0d416f73afde None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:51:03.399613 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-774b593a-140e-4c01-acfe-0d416f73afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:51:03.411080 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 548/1106] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:51:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:51:03.452074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caabc68-2333-4183-812e-b504f24fc995 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:51:03.464449 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caabc68-2333-4183-812e-b504f24fc995 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:51:03.469094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:51:03.469791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:03.470168 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:03.470325 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:03.480303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:51:03.481742 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723def-6c7a-4790-b8f5-a1c682fbbaa2 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:51:03.491378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 559/1107] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:51:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:51:05.889435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3ef1-9491-4176-8b74-2a6dc1eca219 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:05.890047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3ef1-9491-4176-8b74-2a6dc1eca219 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:05.890047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d3ef1-9491-4176-8b74-2a6dc1eca219 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:05.892157 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 549/1108] 10.222.0.17 () {54 vars in 926 bytes} [Fri Jul 15 21:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:51:05.900769 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993154-480d-4271-9476-20c4b2ab81a8 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:05.901232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993154-480d-4271-9476-20c4b2ab81a8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:05.901335 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993154-480d-4271-9476-20c4b2ab81a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:05.921993 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-cf993154-480d-4271-9476-20c4b2ab81a8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:51:05.923201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-cf993154-480d-4271-9476-20c4b2ab81a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:51:05.933160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 560/1109] 10.222.0.17 () {58 vars in 1023 bytes} [Fri Jul 15 21:51:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:51:05.978327 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d3ef1-9491-4176-8b74-2a6dc1eca219 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:51:05.991935 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d3ef1-9491-4176-8b74-2a6dc1eca219 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:51:05.995970 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:51:05.996615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:51:05.996901 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:51:05.997181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:51:06.006371 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:51:06.007803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d1b1-db73-4926-bd42-c71f3a12ed05 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:51:06.017491 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 550/1110] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:51:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:51:15.916850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=33 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:51:16.013182 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=33 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:52:34.873684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:34.874726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:34.874726 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:34.900424 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:52:34.901636 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:34.911323 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 561/1111] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:52:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:52:34.919419 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:34.919965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:34.919965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:34.939875 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:52:34.941082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:34.950047 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 551/1112] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:52:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:52:34.955804 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:34.965998 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed46b-38f0-418c-89fd-368c9d73ae32 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:34.971755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:34.972442 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:34.972719 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:34.972995 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:34.973720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:52:34.974061 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:34.975081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:34.975081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:52:34.975081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:52:34.975971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:34.987978 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 562/1113] 10.222.0.17 () {58 vars in 1152 bytes} [Fri Jul 15 21:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:52:34.996103 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.005498 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9e7d-6eac-4308-9456-7ddc1c5cc1e7 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.010604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.011249 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.011532 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.011805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.012500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.014339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.014339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:52:35.014339 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:52:35.015644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.053638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 552/1114] 10.222.0.17 () {60 vars in 1152 bytes} [Fri Jul 15 21:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:52:35.058681 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.069523 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f519-79c5-46bd-a4c7-bb09d9f14d34 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.133625 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.134256 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.134543 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.134821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.135516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.136545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.136545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:52:35.136545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:52:35.137786 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.159779 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 563/1115] 10.222.0.17 () {60 vars in 1143 bytes} [Fri Jul 15 21:52:35 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:52:35.163817 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.174495 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c64743-031d-4e6c-9a58-937641511ce0 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.179103 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.179763 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.180016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.180342 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.181060 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.182113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.182113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:52:35.182113 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:52:35.183004 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.196543 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 553/1116] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:52:35.200619 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.211262 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffe86-3fc5-409e-987b-cf387b3b4474 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.216464 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.217133 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.217418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.217698 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.218724 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.219755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.219755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:52:35.219755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:52:35.220645 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd2171-7416-4de4-ab56-6acaf0669c03 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.234703 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 564/1117] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:52:35.239251 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.249998 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cafb35-8dfd-45d7-bb30-a9944c376127 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.256408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.257296 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.257573 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.257846 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] PATH_INFO: `/v3/projects/a92553b2faca4ecd8158a5264cabb17d/users/e0769f7666a942c791166b31dfc7e2ab/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.274682 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92553b2faca4ecd8158a5264cabb17d, user_id=e0769f7666a942c791166b31dfc7e2ab, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.275711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.275711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:52:35.275711 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:52:35.277654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca495d95-5bf3-437f-98e8-b744f91e6dc8 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.297802 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 554/1118] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:52:35 2022] PUT /identity/v3/projects/a92553b2faca4ecd8158a5264cabb17d/users/e0769f7666a942c791166b31dfc7e2ab/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:52:35.315862 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f803f-dae3-4cfa-811e-8f48fda90a3c None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.316155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f803f-dae3-4cfa-811e-8f48fda90a3c None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.316433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f803f-dae3-4cfa-811e-8f48fda90a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.343469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-dc1f803f-dae3-4cfa-811e-8f48fda90a3c None None] MFA Rules not processed for user `e0769f7666a942c791166b31dfc7e2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:52:35.344709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-dc1f803f-dae3-4cfa-811e-8f48fda90a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:35.415883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 565/1119] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:52:35 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:52:35.430091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9378-0d6f-40a7-9291-d58db8fb4c94 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.430449 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9378-0d6f-40a7-9291-d58db8fb4c94 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.430749 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9378-0d6f-40a7-9291-d58db8fb4c94 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.432281 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 555/1120] 10.222.0.17 () {54 vars in 963 bytes} [Fri Jul 15 21:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:52:35.437263 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169e26-871f-4992-bc1c-47a8f366768d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.437548 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169e26-871f-4992-bc1c-47a8f366768d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.437826 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169e26-871f-4992-bc1c-47a8f366768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.455879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-9f169e26-871f-4992-bc1c-47a8f366768d None None] MFA Rules not processed for user `c0e23da86db744f88719c5511226d9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:52:35.457068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-9f169e26-871f-4992-bc1c-47a8f366768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:35.506958 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:52:35.516510 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 566/1121] 10.222.0.17 () {58 vars in 1060 bytes} [Fri Jul 15 21:52:35 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:52:35.524211 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9378-0d6f-40a7-9291-d58db8fb4c94 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.536997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9378-0d6f-40a7-9291-d58db8fb4c94 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.540747 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e23da86db744f88719c5511226d9a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.541384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.541696 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.542008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.550773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.552239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.560960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 556/1122] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:52:35 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:52:35.601392 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891590d4-de6e-472f-9814-c49554e11f6d None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.601723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891590d4-de6e-472f-9814-c49554e11f6d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.602043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891590d4-de6e-472f-9814-c49554e11f6d None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.603364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 567/1123] 10.222.0.17 () {52 vars in 829 bytes} [Fri Jul 15 21:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:52:35.608329 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.685467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32aee0-ab34-4a72-9088-c4894a86c54a service cinder] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:35.691500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:35.692385 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.692676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.692950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] PATH_INFO: `/v3/users/e0769f7666a942c791166b31dfc7e2ab` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.694275 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0769f7666a942c791166b31dfc7e2ab)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:35.695293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:35.695293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:52:35.695293 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:52:35.696518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:35.770759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0769f7666a942c791166b31dfc7e2ab'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:35.771420 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0769f7666a942c791166b31dfc7e2ab'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:35.784921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0769f7666a942c791166b31dfc7e2ab'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:35.797812 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0769f7666a942c791166b31dfc7e2ab'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:35.798612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0769f7666a942c791166b31dfc7e2ab'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:35.823079 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 557/1124] 10.222.0.17 () {58 vars in 1223 bytes} [Fri Jul 15 21:52:35 2022] DELETE /identity/v3/users/e0769f7666a942c791166b31dfc7e2ab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:52:35.827795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:35.828065 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:35.828351 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:35.849362 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:52:35.850666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:35.927248 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 568/1125] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:52:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:52:35.937299 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:35.938840 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:35.944443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:52:35.999061 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906bb6c-474f-4f71-bf9c-8751ba6b2714 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:36.003337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:36.003986 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:36.004268 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:36.004542 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:36.014553 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:36.016273 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af82ea3-a5d6-4e4f-8e0f-40d9ef7a5118 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:36.026287 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 558/1126] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:52:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:52:36.400289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:52:36.402595 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:52:36.416742 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94ca30-4357-4780-b4ef-3d55e25b626f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:52:36.422400 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:52:36.423346 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:52:36.423657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:52:36.423885 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] PATH_INFO: `/v3/projects/a92553b2faca4ecd8158a5264cabb17d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:52:36.425076 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92553b2faca4ecd8158a5264cabb17d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:52:36.426132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:52:36.426132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:52:36.426132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:52:36.427327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:52:36.490282 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92553b2faca4ecd8158a5264cabb17d', 'request_id': 'req-2b5b86e6-907b-4f40-9c88-616ff58567df'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:36.501074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92553b2faca4ecd8158a5264cabb17d', 'request_id': 'req-2b5b86e6-907b-4f40-9c88-616ff58567df'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:36.507907 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92553b2faca4ecd8158a5264cabb17d', 'request_id': 'req-2b5b86e6-907b-4f40-9c88-616ff58567df'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:36.527327 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] The token cache is being invalidate because project a92553b2faca4ecd8158a5264cabb17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 21:52:36.527618 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:36.528718 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-2b5b86e6-907b-4f40-9c88-616ff58567df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 21:52:36.530538 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 569/1127] 10.222.0.17 () {58 vars in 1232 bytes} [Fri Jul 15 21:52:36 2022] DELETE /identity/v3/projects/a92553b2faca4ecd8158a5264cabb17d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:52:46.021761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=25 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:52:46.523977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:54:01.227829 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:01.228457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:01.228457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:01.229780 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 559/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:01.235982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed8ba-885d-4dae-8d9b-2feddf42cbea None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:01.236770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed8ba-885d-4dae-8d9b-2feddf42cbea None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:01.236956 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed8ba-885d-4dae-8d9b-2feddf42cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:01.315803 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-b4eed8ba-885d-4dae-8d9b-2feddf42cbea None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:01.317118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-b4eed8ba-885d-4dae-8d9b-2feddf42cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:01.413677 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 570/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:54:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:01.574219 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:01.577337 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:01.682796 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a687e-3afe-4d90-a7f0-1bdbe509b23a None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:01.688442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:01.689117 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:01.689402 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:01.689679 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:01.698279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:01.699874 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6cf8-5f63-4112-8222-af7ba43ee246 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:01.709662 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 560/1130] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:02.550286 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5517-4876-4238-9757-24dddb95cca3 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:02.550851 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5517-4876-4238-9757-24dddb95cca3 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:02.550977 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5517-4876-4238-9757-24dddb95cca3 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:02.553164 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 571/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:02.559064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337d59-e285-4aa9-b318-823e01f87ba2 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:02.559571 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337d59-e285-4aa9-b318-823e01f87ba2 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:02.559734 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337d59-e285-4aa9-b318-823e01f87ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:02.585447 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-db337d59-e285-4aa9-b318-823e01f87ba2 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:02.586698 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-db337d59-e285-4aa9-b318-823e01f87ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:02.594651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 561/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:54:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:02.753816 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d5517-4876-4238-9757-24dddb95cca3 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:02.768789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d5517-4876-4238-9757-24dddb95cca3 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:02.774217 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:02.774866 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:02.775152 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:02.775431 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:02.785686 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:02.787367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471d053-3c7e-4510-886d-4d661077edde service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:02.797166 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 572/1133] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:07.596414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d7ce-23e1-4d21-b41c-c5dd1dfcaed8 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:07.597019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d7ce-23e1-4d21-b41c-c5dd1dfcaed8 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:07.597019 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d7ce-23e1-4d21-b41c-c5dd1dfcaed8 None None] PATH_INFO: `/v3` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:07.598324 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 562/1134] 10.222.0.52 () {54 vars in 925 bytes} [Fri Jul 15 21:54:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:54:07.626225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b6c2-7591-419d-9ec0-c7326d5beadd None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:07.626700 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b6c2-7591-419d-9ec0-c7326d5beadd None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:07.626821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b6c2-7591-419d-9ec0-c7326d5beadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:07.659053 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-6d67b6c2-7591-419d-9ec0-c7326d5beadd None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:07.660226 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-6d67b6c2-7591-419d-9ec0-c7326d5beadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:07.717685 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:54:07.728239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 573/1135] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jul 15 21:54:07 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:12.120684 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509252-6cb8-4884-a9e9-cd6af7bea2c4 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:12.121612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509252-6cb8-4884-a9e9-cd6af7bea2c4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:12.121612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509252-6cb8-4884-a9e9-cd6af7bea2c4 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:12.123823 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 563/1136] 10.222.0.17 () {54 vars in 960 bytes} [Fri Jul 15 21:54:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:12.131237 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a636-6a29-46ee-9d68-06e2d0dbd1de None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:12.131714 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a636-6a29-46ee-9d68-06e2d0dbd1de None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:12.131818 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a636-6a29-46ee-9d68-06e2d0dbd1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:12.151506 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-2406a636-6a29-46ee-9d68-06e2d0dbd1de None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:12.153062 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-2406a636-6a29-46ee-9d68-06e2d0dbd1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:12.162503 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 574/1137] 10.222.0.17 () {58 vars in 1057 bytes} [Fri Jul 15 21:54:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:54:12.169924 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509252-6cb8-4884-a9e9-cd6af7bea2c4 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:12.184479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509252-6cb8-4884-a9e9-cd6af7bea2c4 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:12.189736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:12.190406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:12.190687 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:12.190960 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:12.199915 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:12.201538 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5d6c-3777-44cc-a188-d0b49fcbd900 service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:12.211414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 564/1138] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:14.064098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46c35-bced-440a-bcc4-6aa4649894bc None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:14.064704 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46c35-bced-440a-bcc4-6aa4649894bc None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:14.064704 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46c35-bced-440a-bcc4-6aa4649894bc None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:14.066032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:54:14.072147 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09af81e-8203-403e-9b7f-e6431fc64e91 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:14.072624 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09af81e-8203-403e-9b7f-e6431fc64e91 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:14.072726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09af81e-8203-403e-9b7f-e6431fc64e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:14.102604 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-b09af81e-8203-403e-9b7f-e6431fc64e91 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:14.103820 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b09af81e-8203-403e-9b7f-e6431fc64e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:14.113021 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:54:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:14.275418 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46c35-bced-440a-bcc4-6aa4649894bc None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:14.290963 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46c35-bced-440a-bcc4-6aa4649894bc None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:14.296067 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:14.296704 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:14.296983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:14.297252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:14.305883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:14.307597 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee79d0-2265-47dd-9857-d5a2b1511e7b service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:14.318289 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 576/1141] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:15.147435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc03a33-462b-4de9-a05b-629242ba3b5d None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:15.148033 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc03a33-462b-4de9-a05b-629242ba3b5d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:15.148145 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc03a33-462b-4de9-a05b-629242ba3b5d None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:15.150408 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 21:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:15.159023 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ff3a-e606-4238-a2e1-cc19231de34a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:15.159432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ff3a-e606-4238-a2e1-cc19231de34a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:15.159854 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ff3a-e606-4238-a2e1-cc19231de34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:15.188567 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-5da8ff3a-e606-4238-a2e1-cc19231de34a None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:15.189795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-5da8ff3a-e606-4238-a2e1-cc19231de34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:15.200162 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 21:54:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:54:15.368655 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc03a33-462b-4de9-a05b-629242ba3b5d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:15.393340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc03a33-462b-4de9-a05b-629242ba3b5d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:15.401939 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:15.402952 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:15.403232 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:15.403506 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:15.413280 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:15.414944 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798900fa-7cfe-4267-963d-fb808540a5c9 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:15.424997 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 567/1144] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:19.756513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:19.757411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:19.757411 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:19.759507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:19.764953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b1480-db32-4682-b76a-2af7db9e36fb None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:19.765403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b1480-db32-4682-b76a-2af7db9e36fb None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:19.765513 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b1480-db32-4682-b76a-2af7db9e36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:19.786602 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-605b1480-db32-4682-b76a-2af7db9e36fb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:19.787828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-605b1480-db32-4682-b76a-2af7db9e36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:19.797171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:54:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:19.834723 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:19.836347 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:19.903610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b6537-13a3-48a9-a264-6b0c418323e5 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:19.908110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:19.908770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:19.909053 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:19.909333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:19.919498 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:19.920955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db1b8b-6158-4a17-8d2e-ddcc288e31ba service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:19.930781 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 579/1147] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:22.249098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:22.249670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:22.249670 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:22.251546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 569/1148] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:54:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:22.259080 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c17d1-d47e-4d0f-98ed-36503575cfd8 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:22.259555 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c17d1-d47e-4d0f-98ed-36503575cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:22.259665 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c17d1-d47e-4d0f-98ed-36503575cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:22.279478 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-508c17d1-d47e-4d0f-98ed-36503575cfd8 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:22.280656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-508c17d1-d47e-4d0f-98ed-36503575cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:22.289128 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 580/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:54:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:54:22.330168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:22.333457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:22.354633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476bc66-2a66-4045-92db-a837ba914177 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:22.359238 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:22.359880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:22.360165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:22.360443 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:22.370709 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:22.372129 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d0ead-7701-41cb-a752-7b5ac00cab9e service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:22.382320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 570/1150] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:26.240469 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:26.241088 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:26.241088 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:26.242565 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 581/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:26.249160 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6701b-04ab-4c79-8ede-33cffbc7ab4d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:26.249942 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6701b-04ab-4c79-8ede-33cffbc7ab4d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:26.250168 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6701b-04ab-4c79-8ede-33cffbc7ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:26.259950 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=67 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:54:26.273450 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-94a6701b-04ab-4c79-8ede-33cffbc7ab4d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:26.274713 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-94a6701b-04ab-4c79-8ede-33cffbc7ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:26.284205 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 571/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:54:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:26.553883 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:26.555876 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:26.618988 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d1b4-4ea4-431b-b0d9-17fb4e848d86 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:26.622877 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e23da86db744f88719c5511226d9a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:26.623518 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:26.623795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:26.624069 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:26.633705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:26.635169 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537788-c662-4a9b-b027-48a413524cff service cinder] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:26.644560 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 582/1153] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:28.890661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:28.891519 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:28.891704 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:28.893769 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 572/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 21:54:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:54:28.900758 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad0f-7f10-47e7-b0d3-a3f3819749fb None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:28.901210 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad0f-7f10-47e7-b0d3-a3f3819749fb None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:28.901316 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad0f-7f10-47e7-b0d3-a3f3819749fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:28.921557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-56e9ad0f-7f10-47e7-b0d3-a3f3819749fb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:54:28.922788 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-56e9ad0f-7f10-47e7-b0d3-a3f3819749fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:28.932003 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 583/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 21:54:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:54:29.213377 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:54:29.216607 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:54:29.235890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba5282-c431-40a8-b62b-69e34fb59f44 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:54:29.240181 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e23da86db744f88719c5511226d9a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:54:29.240868 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:54:29.241151 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:54:29.241423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:54:29.251946 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:54:29.253382 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872cc9b-a884-47b7-ad2d-36a163224a94 service cinder] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:54:29.263175 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 573/1156] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:54:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:54:38.916118 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=70 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:54:39.259227 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=8 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:55:49.282037 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dcd8-11ad-423f-8899-9e03616a9762 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.282766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dcd8-11ad-423f-8899-9e03616a9762 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.282766 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dcd8-11ad-423f-8899-9e03616a9762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.288705 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfdff-20b2-4101-9915-3d6426b05335 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.289153 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfdff-20b2-4101-9915-3d6426b05335 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.289276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfdff-20b2-4101-9915-3d6426b05335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.302030 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a8c4dcd8-11ad-423f-8899-9e03616a9762 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.303249 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a8c4dcd8-11ad-423f-8899-9e03616a9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.307125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e5bdfdff-20b2-4101-9915-3d6426b05335 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.308283 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e5bdfdff-20b2-4101-9915-3d6426b05335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.312433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 584/1157] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:49.316433 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 574/1158] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:49.320593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.320882 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.321156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.324232 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.324516 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.324789 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.339791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.341334 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.343125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.344288 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.349929 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 585/1159] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:49.352169 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 575/1160] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:49.354544 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.356549 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.363916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1679caf-f51e-4e58-99cc-88a9ef89c90d None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.365623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e1bf-868d-4d68-8ae1-47e1123f0dcb None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.368716 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.369361 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.369638 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.369943 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.370414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.370673 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:55:49.370980 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.371184 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.371434 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.371851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] PATH_INFO: `/v3/domains` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.372631 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 21:55:49.372755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.372932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.373948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:55:49.373948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:55:49.373948 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:55:49.374819 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.385307 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 586/1161] 10.222.0.17 () {58 vars in 1152 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:55:49.387395 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 576/1162] 10.222.0.17 () {58 vars in 1152 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 21:55:49.393337 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.395340 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.404253 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d154f4-d986-422d-bb3e-5447c7541f6c admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.409414 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.409724 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c7cf5-17f2-4650-9f0c-bf95e0f1977a admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.410113 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.410401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.410680 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.411377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.412408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:55:49.412408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:55:49.412408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:55:49.413610 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.414813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.415474 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.415760 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.416037 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.416732 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.419244 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.451572 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 587/1163] 10.222.0.17 () {60 vars in 1152 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:49.455991 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.458700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 577/1164] 10.222.0.17 () {60 vars in 1152 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:49.462822 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.517821 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f15ccb-d1cd-4f1d-a3fb-2bd194f75385 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.522436 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.523109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.523355 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4778-190e-4384-81e5-4844d3219c69 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.523467 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.523658 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.524350 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.526315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.528686 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.529391 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.529674 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.530026 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.530704 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.531736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: WARNING py.warnings [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:55:49.531736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: warnings.warn(msg) Jul 15 21:55:49.531736 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: Jul 15 21:55:49.533003 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.549894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 588/1165] 10.222.0.17 () {60 vars in 1143 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:49.553658 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.557793 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 578/1166] 10.222.0.17 () {60 vars in 1143 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:55:49.561850 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.563247 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6aa42-fd84-4fb5-b81b-a4976605dde2 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.567793 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.568471 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.568754 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.569032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.569756 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.571408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.571878 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b1e6-318e-46be-80d1-48f02d78c5a4 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.577154 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.577815 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.578130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.578411 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.579137 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.580867 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.581406 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 589/1167] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:55:49.585336 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.590921 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 579/1168] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:55:49.594741 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.594903 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36898e-d5f4-4572-a7db-6fc0bf0fb2c3 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.599595 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.600131 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.600417 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.600711 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.601432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.603066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.604195 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a2244-0180-465e-876b-bfc9f68e5766 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.610110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.610754 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.611048 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.611325 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.612039 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.613619 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.618562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 590/1169] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:55:49.619592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.624483 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 580/1170] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:55:49.628707 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.630203 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2754fd-e5e2-4ab7-994a-d13f39927051 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.635573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.636499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.636900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.637304 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] PATH_INFO: `/v3/projects/43130c77a01b448aa67e7a93a17d418f/users/969a0d0621664a8dab26e1be8c850782/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.639735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2563dbb-b81d-4bb1-9d17-6c1eac58e29b admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.644880 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.645767 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.646082 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.646396 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] PATH_INFO: `/v3/projects/08dd037f33904203970a921d581d0177/users/209467ad572243a0b689b38121194291/roles/54adb043b23b4378ad3430fdd81e36bd` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.653294 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43130c77a01b448aa67e7a93a17d418f, user_id=969a0d0621664a8dab26e1be8c850782, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.654303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: WARNING py.warnings [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 21:55:49.654303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: warnings.warn(msg) Jul 15 21:55:49.654303 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: Jul 15 21:55:49.656225 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef2b4-0d2c-4069-93bb-db5b688e39fb admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.664035 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dd037f33904203970a921d581d0177, user_id=209467ad572243a0b689b38121194291, role_id=54adb043b23b4378ad3430fdd81e36bd)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.667375 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da95b-c663-49a2-a32d-3a6fc8c0b22c admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.671753 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 591/1171] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:49 2022] PUT /identity/v3/projects/43130c77a01b448aa67e7a93a17d418f/users/969a0d0621664a8dab26e1be8c850782/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:55:49.677494 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.677920 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.678299 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.681497 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 581/1172] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:49 2022] PUT /identity/v3/projects/08dd037f33904203970a921d581d0177/users/209467ad572243a0b689b38121194291/roles/54adb043b23b4378ad3430fdd81e36bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:55:49.686703 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061549b-4574-4083-b388-3deb410a146d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.686994 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061549b-4574-4083-b388-3deb410a146d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.687295 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061549b-4574-4083-b388-3deb410a146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.696359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.697590 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.704128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5061549b-4574-4083-b388-3deb410a146d None None] MFA Rules not processed for user `d7948ce1e03b4c18a198a75488650567`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:49.705313 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5061549b-4574-4083-b388-3deb410a146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:49.740844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:55:49.748530 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:55:49.761231 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 592/1173] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:55:49.767406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 582/1174] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:49.771452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.777717 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061549b-4574-4083-b388-3deb410a146d None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:49.826876 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca248a0b-98ad-49d7-b2cb-4fc722310289 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.830539 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.831185 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.831454 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061549b-4574-4083-b388-3deb410a146d None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:49.831566 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.831725 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.835013 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:49.835660 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:49.835941 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:49.836215 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:49.840683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.842141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4270e4-ee8f-4487-84e2-9d6889a5a478 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.845487 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:49.846966 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:49.851477 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 593/1175] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:55:49.856502 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 583/1176] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:55:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:55:54.533305 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:54.534042 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:54.534042 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:54.591474 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:54.592863 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:54.721480 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 594/1177] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:54 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:55:54.726125 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:54.748121 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5718-a2e5-4ff6-9894-bfe46bbecf4f service neutron] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:54.759400 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:54.761643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:54.762578 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:54.762962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:54.763715 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:54.778963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:54.844834 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 584/1178] 10.222.0.17 () {60 vars in 1152 bytes} [Fri Jul 15 21:55:54 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:54.846032 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:54.872448 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb70ba-dfa4-4838-a034-9b17bf643a8f None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:54.999235 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.000245 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.000674 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.001090 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] PATH_INFO: `/v3/users` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.002236 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.005094 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.036082 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 595/1179] 10.222.0.17 () {60 vars in 1143 bytes} [Fri Jul 15 21:55:54 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:55.040075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.058254 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2034-4deb-4520-8946-8724dc7909a6 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.076290 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.077979 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.078432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.078859 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.079839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.082067 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.102853 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 585/1180] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:55:55.103051 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.116055 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba327-7d24-4766-9dba-9abf3c405c0a admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.120348 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.121811 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.122328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.122652 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] PATH_INFO: `/v3/projects/bd8a4859c56a4060a1be5742e7693730/users/11226c6696094b76a3ab5c772cd3a7b8/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.130496 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:55:55.147208 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8a4859c56a4060a1be5742e7693730, user_id=11226c6696094b76a3ab5c772cd3a7b8, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.150367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.182192 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 596/1181] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:55 2022] PUT /identity/v3/projects/bd8a4859c56a4060a1be5742e7693730/users/11226c6696094b76a3ab5c772cd3a7b8/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 21:55:55.189255 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.203471 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e7e7-80e6-4b77-925c-d840371ce428 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.285744 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.286479 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.286761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.287036 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.287779 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.292477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4357d-14dc-4a87-981d-6e5070c7ad94 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.306842 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 586/1182] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 21:55:55.311205 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.323004 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc13b7-f1bc-41c4-bc1e-3c12099fe35b admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.331470 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.333011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.333011 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.333275 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] PATH_INFO: `/v3/projects/bd8a4859c56a4060a1be5742e7693730/users/11226c6696094b76a3ab5c772cd3a7b8/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.335684 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8a4859c56a4060a1be5742e7693730, user_id=11226c6696094b76a3ab5c772cd3a7b8, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.338636 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.360140 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 597/1183] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:55 2022] PUT /identity/v3/projects/bd8a4859c56a4060a1be5742e7693730/users/11226c6696094b76a3ab5c772cd3a7b8/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:55:55.460405 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.460803 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.461165 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.508104 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] MFA Rules not processed for user `969a0d0621664a8dab26e1be8c850782`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:55:55.509464 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:55:55.576752 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:55:55.607897 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 587/1184] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:55:55 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:55:55.612835 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.684271 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475133-f0d6-4fbe-be5f-72afaddd0a23 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.688925 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.689697 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.690096 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.690440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] PATH_INFO: `/v3/projects` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.691236 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.693228 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.728075 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 598/1185] 10.222.0.17 () {60 vars in 1152 bytes} [Fri Jul 15 21:55:55 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 21:55:55.733069 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.747271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67171e60-2f8f-4801-965a-0140f89d723a None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.853735 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.854533 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.854885 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.855248 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] PATH_INFO: `/v3/users` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.856110 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.858962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.903547 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 588/1186] 10.222.0.17 () {60 vars in 1143 bytes} [Fri Jul 15 21:55:55 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 21:55:55.905437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.917466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9b95-f61d-4b5c-b1e1-ff3a28db552d admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.925406 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.926472 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.926612 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.926873 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.927683 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.929377 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:55.944656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 599/1187] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:55:55.946493 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:55.963615 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211aec5-be5f-42e2-9a86-31eedca44864 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:55.970105 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:55.971304 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:55.971661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:55.972008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] PATH_INFO: `/v3/projects/578100b383f64cc79aa94edb666dfe4f/users/ea76dae37d6c49689f15fbfa1465214f/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:55.994661 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578100b383f64cc79aa94edb666dfe4f, user_id=ea76dae37d6c49689f15fbfa1465214f, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:55.998024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:56.019490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 589/1188] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:55 2022] PUT /identity/v3/projects/578100b383f64cc79aa94edb666dfe4f/users/ea76dae37d6c49689f15fbfa1465214f/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:55:56.023708 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:56.036830 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d83394-388c-48f6-90af-3b3e5da0fcae admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:56.159066 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:56.162138 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:56.162841 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:56.163187 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] PATH_INFO: `/v3/roles` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:56.164356 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:56.166837 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ec852-f00c-4526-a608-e9c8671d7751 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:56.185176 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 600/1189] 10.222.0.17 () {58 vars in 1121 bytes} [Fri Jul 15 21:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 21:55:56.189676 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:55:56.205737 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49a59b-2fdf-4c85-90f3-ecd651bee276 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:55:56.230623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:55:56.231891 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:55:56.232469 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:55:56.233172 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] PATH_INFO: `/v3/projects/578100b383f64cc79aa94edb666dfe4f/users/ea76dae37d6c49689f15fbfa1465214f/roles/2d994bc4bf4f4e3287429d64fb393a8d` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:55:56.238477 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578100b383f64cc79aa94edb666dfe4f, user_id=ea76dae37d6c49689f15fbfa1465214f, role_id=2d994bc4bf4f4e3287429d64fb393a8d)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:55:56.242210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:55:56.258258 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 590/1190] 10.222.0.17 () {60 vars in 1482 bytes} [Fri Jul 15 21:55:56 2022] PUT /identity/v3/projects/578100b383f64cc79aa94edb666dfe4f/users/ea76dae37d6c49689f15fbfa1465214f/roles/2d994bc4bf4f4e3287429d64fb393a8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 21:56:02.852130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15281a8-ae97-4cbc-8b76-35103ab933a2 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:02.852800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15281a8-ae97-4cbc-8b76-35103ab933a2 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:02.852800 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15281a8-ae97-4cbc-8b76-35103ab933a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:02.892648 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c15281a8-ae97-4cbc-8b76-35103ab933a2 None None] MFA Rules not processed for user `11226c6696094b76a3ab5c772cd3a7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:02.904163 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c15281a8-ae97-4cbc-8b76-35103ab933a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:02.951401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:03.010634 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 601/1191] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:56:02 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:03.024990 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:03.027417 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:03.112828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc04d-5396-4985-a9ec-e776a9497b27 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:03.117135 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fa72ed4554daaa34a0fe6f5d6f8ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:03.117955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:03.118335 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:03.118813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:03.162266 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:03.187938 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:03.189253 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:03.204847 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 591/1192] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:03 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:03.635129 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4401c-5a93-4459-b5f9-50558f1b5a7d None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:03.635426 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4401c-5a93-4459-b5f9-50558f1b5a7d None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:03.635705 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4401c-5a93-4459-b5f9-50558f1b5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:03.673376 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-a7d4401c-5a93-4459-b5f9-50558f1b5a7d None None] MFA Rules not processed for user `ea76dae37d6c49689f15fbfa1465214f`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:03.674109 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-a7d4401c-5a93-4459-b5f9-50558f1b5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:03.752227 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 602/1193] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:56:03 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:03.765188 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:03.773850 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68039b19-7325-4f44-a96d-bd493b22eea7 service glance] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:03.778770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fa72ed4554daaa34a0fe6f5d6f8ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:03.779457 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:03.779710 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:03.779999 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:03.859792 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:03.867955 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bfab7-0b0d-4d16-a823-972b888f0d06 service glance] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:03.882208 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 592/1194] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:03 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:12.325954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4184-bee0-4bb3-ad5e-859d460850cc None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.326516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4184-bee0-4bb3-ad5e-859d460850cc None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.326516 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f4184-bee0-4bb3-ad5e-859d460850cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.355031 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-d03f4184-bee0-4bb3-ad5e-859d460850cc None None] MFA Rules not processed for user `969a0d0621664a8dab26e1be8c850782`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:12.356937 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-d03f4184-bee0-4bb3-ad5e-859d460850cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:12.365900 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 603/1195] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:56:12 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:12.691974 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e282-0ba9-421e-84b5-350d004c85e4 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.692969 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e282-0ba9-421e-84b5-350d004c85e4 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.693436 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e282-0ba9-421e-84b5-350d004c85e4 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.695098 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 593/1196] 10.222.0.17 () {54 vars in 961 bytes} [Fri Jul 15 21:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:12.702657 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1c91-e34c-41de-9bf6-8cd3edd8960f None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.702947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1c91-e34c-41de-9bf6-8cd3edd8960f None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.703227 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1c91-e34c-41de-9bf6-8cd3edd8960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.737753 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-791c1c91-e34c-41de-9bf6-8cd3edd8960f None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:12.739130 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-791c1c91-e34c-41de-9bf6-8cd3edd8960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:12.827000 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 604/1197] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Jul 15 21:56:12 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:12.832406 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.832801 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.833379 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.834953 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 594/1198] 10.222.0.17 () {54 vars in 912 bytes} [Fri Jul 15 21:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:12.841666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c959e6-4c4c-476f-bfc1-cbc7c8f5498a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.842364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c959e6-4c4c-476f-bfc1-cbc7c8f5498a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.842513 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c959e6-4c4c-476f-bfc1-cbc7c8f5498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.868182 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-74c959e6-4c4c-476f-bfc1-cbc7c8f5498a None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:12.869433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-74c959e6-4c4c-476f-bfc1-cbc7c8f5498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:12.879844 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 605/1199] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Jul 15 21:56:12 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:12.892359 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:12.894138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:12.909638 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f42ac-d821-4264-9a4b-577d8ddbef43 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:12.913546 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fa72ed4554daaa34a0fe6f5d6f8ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:12.914237 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:12.914518 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:12.914789 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:12.927000 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:12.928461 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f415ef5-51a3-4a12-ab05-287419fa2de7 service glance] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:12.939467 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 595/1200] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:12 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:13.320873 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869dad9-2b88-4f94-aa02-30f62912c4ff None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.321536 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869dad9-2b88-4f94-aa02-30f62912c4ff None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.322072 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869dad9-2b88-4f94-aa02-30f62912c4ff None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.323964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 606/1201] 10.222.0.17 () {54 vars in 912 bytes} [Fri Jul 15 21:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:13.330220 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0cf63-6436-4831-b5ba-4ba9493836ac None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.330759 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0cf63-6436-4831-b5ba-4ba9493836ac None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.331057 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0cf63-6436-4831-b5ba-4ba9493836ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.363107 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-e5c0cf63-6436-4831-b5ba-4ba9493836ac None None] MFA Rules not processed for user `661831a6f5214520a43b84201a4588db`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:13.364594 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-e5c0cf63-6436-4831-b5ba-4ba9493836ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:13.433633 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 596/1202] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Jul 15 21:56:13 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:13.445432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869dad9-2b88-4f94-aa02-30f62912c4ff None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:13.458504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869dad9-2b88-4f94-aa02-30f62912c4ff None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:13.462308 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:13.462961 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.463239 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.463511 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.471197 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:13.472653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3618f-b135-42d7-ad9d-f46f3df7f97c service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:13.480922 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 607/1203] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:13 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:13.915760 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7c7d-276d-4e4e-9df6-1c9c4ef9cb98 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.916278 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7c7d-276d-4e4e-9df6-1c9c4ef9cb98 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.916387 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7c7d-276d-4e4e-9df6-1c9c4ef9cb98 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.917690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 597/1204] 10.222.0.17 () {54 vars in 961 bytes} [Fri Jul 15 21:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:13.924048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb308f-1cb2-43a4-a3f6-1ff88291956a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.924359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb308f-1cb2-43a4-a3f6-1ff88291956a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.924640 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb308f-1cb2-43a4-a3f6-1ff88291956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.927472 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79f4c-fca4-483d-8f80-cad28f7a44d2 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.927934 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79f4c-fca4-483d-8f80-cad28f7a44d2 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.928384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79f4c-fca4-483d-8f80-cad28f7a44d2 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.930207 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 598/1205] 10.222.0.17 () {54 vars in 960 bytes} [Fri Jul 15 21:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:56:13.937143 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.937508 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.937908 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.943974 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-22eb308f-1cb2-43a4-a3f6-1ff88291956a None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:13.945159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-22eb308f-1cb2-43a4-a3f6-1ff88291956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:13.956015 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 608/1206] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Jul 15 21:56:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:56:13.963224 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd5ec-bf45-472d-8eb9-b51daacc4137 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.963510 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd5ec-bf45-472d-8eb9-b51daacc4137 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.963782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd5ec-bf45-472d-8eb9-b51daacc4137 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.965219 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 609/1207] 10.222.0.17 () {54 vars in 912 bytes} [Fri Jul 15 21:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:13.966760 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:13.969439 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:13.970942 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:13.971233 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:13.971508 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:13.991432 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=100 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:14.006257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:14.007573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:14.017451 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 610/1208] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Jul 15 21:56:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:14.040864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:14.057770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf931a6-8196-471f-a329-92cd6c5d51ca None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:14.068637 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:14.070197 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:14.071796 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:14.072073 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:14.076726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=100 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:14.090695 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:14.092395 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393950-01a0-44a7-855a-8bcce0beb972 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:14.095350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 599/1209] 10.222.0.17 () {58 vars in 1057 bytes} [Fri Jul 15 21:56:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 21:56:14.102420 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:14.104040 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 611/1210] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:14.115536 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb50e7f-7746-4b4d-8115-0f28c0f771fc None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:14.121734 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:14.122865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:14.123150 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:14.123423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:14.125335 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:14.140862 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:14.142605 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:14.154308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 600/1211] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:24.099068 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=7 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:24.149770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=7 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:24.238910 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34b8d-0311-4d4d-ae7e-c03caa79ce6a None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:24.239278 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34b8d-0311-4d4d-ae7e-c03caa79ce6a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:24.239795 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34b8d-0311-4d4d-ae7e-c03caa79ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:24.260091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-b2e34b8d-0311-4d4d-ae7e-c03caa79ce6a None None] MFA Rules not processed for user `661831a6f5214520a43b84201a4588db`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:24.261483 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-b2e34b8d-0311-4d4d-ae7e-c03caa79ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:24.269132 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 612/1212] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jul 15 21:56:24 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:24.282639 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:24.292301 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482219f-4bc4-4710-a6be-1e2fd787bd14 service placement] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:24.295965 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:24.296612 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:24.296925 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:24.297201 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:24.304276 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:24.305702 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e18b-e48b-410c-ba0c-a24002721e0f service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:24.313442 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 601/1213] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:24 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:25.083666 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c243f-b195-4dce-98ed-d752dc0b635a None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:25.084025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c243f-b195-4dce-98ed-d752dc0b635a None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:25.084370 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c243f-b195-4dce-98ed-d752dc0b635a None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:25.085897 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 613/1214] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 21:56:25.149420 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea2d4-da91-4c75-ae93-be12095c363d None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:25.149634 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea2d4-da91-4c75-ae93-be12095c363d None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:25.149898 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea2d4-da91-4c75-ae93-be12095c363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:25.174178 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-943ea2d4-da91-4c75-ae93-be12095c363d None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:25.177128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-943ea2d4-da91-4c75-ae93-be12095c363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:25.191744 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 602/1215] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:56:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:25.384981 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c243f-b195-4dce-98ed-d752dc0b635a None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:25.409266 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c243f-b195-4dce-98ed-d752dc0b635a None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:25.415589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:25.416355 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:25.416720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:25.417111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:25.435783 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:25.440044 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06c2e-bdca-42f8-a767-4afee222d19a service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:25.452720 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 614/1216] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:31.660811 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d009d-27a4-4b1e-b2be-45bc9da0ae82 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:31.661445 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d009d-27a4-4b1e-b2be-45bc9da0ae82 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:31.661445 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d009d-27a4-4b1e-b2be-45bc9da0ae82 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:31.662761 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 603/1217] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:31.676663 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:31.678134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:31.678419 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:31.702367 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:31.703809 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:31.713535 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 615/1218] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:56:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:31.732332 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d009d-27a4-4b1e-b2be-45bc9da0ae82 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:31.746890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d009d-27a4-4b1e-b2be-45bc9da0ae82 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:31.751418 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:31.752064 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:31.752347 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:31.752616 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:31.761166 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:31.762894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023f18-02ca-45d1-b259-eed05fb79acc service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:31.772362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 604/1219] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 21:56:41.696025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=12 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:41.768386 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=15 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:44.054717 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:44.065651 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8743e-69a5-482f-8592-92b59cbb4452 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:44.069621 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:44.070315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:44.070603 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:44.070882 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:44.080594 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:44.082110 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b301c-2bd9-4ef7-a8db-97548fd0f51d service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:44.091550 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 616/1220] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:44 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:48.433678 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab70f5-657e-416e-b192-62a9b3814809 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:48.434786 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab70f5-657e-416e-b192-62a9b3814809 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:48.435308 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab70f5-657e-416e-b192-62a9b3814809 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:48.437975 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 605/1221] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 21:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 21:56:48.482789 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ad2b-5a06-4381-94a3-fe8e8d30ab03 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:48.484905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ad2b-5a06-4381-94a3-fe8e8d30ab03 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:48.485427 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ad2b-5a06-4381-94a3-fe8e8d30ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:48.516580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-8a88ad2b-5a06-4381-94a3-fe8e8d30ab03 None None] MFA Rules not processed for user `580e48715b944a32a3b1218de325b996`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:56:48.522996 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-8a88ad2b-5a06-4381-94a3-fe8e8d30ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:56:48.537562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 617/1222] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 21:56:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:56:48.559548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab70f5-657e-416e-b192-62a9b3814809 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:56:48.582106 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab70f5-657e-416e-b192-62a9b3814809 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:56:48.588423 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:56:48.589892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:56:48.590469 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:56:48.591075 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:56:48.605053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:56:48.611126 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f89946-93a5-426f-b1e0-af544c7dcca5 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:56:48.624338 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 606/1223] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:56:48 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:56:58.508601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=9 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:56:58.618890 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=6 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:57:02.905917 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:57:02.906509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:57:02.906509 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:57:02.925302 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:57:02.926606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:57:02.937617 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 618/1224] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:57:02 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:57:03.245653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57bc-86ae-4ef3-8fbe-d7f2d4213e82 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:57:03.246548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57bc-86ae-4ef3-8fbe-d7f2d4213e82 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:57:03.246548 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57bc-86ae-4ef3-8fbe-d7f2d4213e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:57:03.273562 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-fb4e57bc-86ae-4ef3-8fbe-d7f2d4213e82 None None] MFA Rules not processed for user `661831a6f5214520a43b84201a4588db`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:57:03.274770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-fb4e57bc-86ae-4ef3-8fbe-d7f2d4213e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:57:03.282472 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 607/1225] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Jul 15 21:57:03 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:57:03.296545 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:57:03.314971 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c11a98-75d5-4a3f-8fb3-07168e29fc53 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:57:03.321490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:57:03.322526 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:57:03.322962 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:57:03.323344 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:57:03.335396 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:57:03.336878 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39dea8-d0ae-4ba8-b17f-1e0a943918d3 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:57:03.345114 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 619/1226] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:57:03 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:57:13.266582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:57:13.341589 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=9 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:57:26.118410 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de8e2-4325-46ea-98f7-6f13a759dd00 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:57:26.118903 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de8e2-4325-46ea-98f7-6f13a759dd00 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:57:26.119008 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de8e2-4325-46ea-98f7-6f13a759dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:57:26.143207 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-8c5de8e2-4325-46ea-98f7-6f13a759dd00 None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:57:26.144409 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-8c5de8e2-4325-46ea-98f7-6f13a759dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:57:26.152733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 608/1227] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:57:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:57:36.137603 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:57:39.679098 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:57:39.679581 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:57:39.679662 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:57:39.698366 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:57:39.699562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:57:39.707656 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 620/1228] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:57:39 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:57:49.692864 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:58:36.253196 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:58:36.253730 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:58:36.253730 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:58:36.279733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 21:58:36.281659 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:58:36.294319 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 609/1229] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 21:58:36 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 21:58:46.269809 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=3 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:58:49.370159 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:58:49.393401 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefa0d4-3cce-4eee-b67a-5a7f8cc17f43 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:58:49.397328 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:58:49.398014 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:58:49.398298 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:58:49.398574 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:58:49.408832 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:58:49.410297 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05034536-d298-4f25-9b4a-d92560a618b1 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:58:49.419527 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 621/1230] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:58:49 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:58:59.415641 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=10 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:59:13.839910 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:59:13.866596 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690e5a-cafa-4c14-ae05-6749248e0fbc None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:59:13.872240 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:59:13.872894 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:59:13.873171 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:59:13.873493 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:59:13.882482 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:59:13.884236 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:59:13.894733 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 610/1231] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 21:59:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 21:59:23.890350 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=10 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:00:36.720859 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5dbe9-b4c2-4f6f-8eb7-7cdb72f2fce8 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:00:36.721397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5dbe9-b4c2-4f6f-8eb7-7cdb72f2fce8 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:00:36.721397 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5dbe9-b4c2-4f6f-8eb7-7cdb72f2fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:00:36.739855 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-71f5dbe9-b4c2-4f6f-8eb7-7cdb72f2fce8 None None] MFA Rules not processed for user `969a0d0621664a8dab26e1be8c850782`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 22:00:36.741057 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-71f5dbe9-b4c2-4f6f-8eb7-7cdb72f2fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:00:36.749170 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 622/1232] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 22:00:36 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 22:00:46.734389 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=3 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:01:04.919865 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:01:04.950349 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074ab3-2186-4746-b33b-2e5e3565104c service placement] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:01:04.956849 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:01:04.957504 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:04.957790 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:04.958102 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:04.966922 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:01:04.968500 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:01:04.977773 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 611/1233] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:01:04 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:01:08.732437 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:08.732940 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:08.733025 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:08.751301 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 22:01:08.752521 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:01:08.759669 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 623/1234] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 22:01:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 22:01:14.206498 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:01:14.216840 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9f20-1d9f-4208-a88a-2a3bb7202f72 service nova] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:01:14.221192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:01:14.221839 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:14.222158 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:14.222432 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:14.232923 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:01:14.234404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:01:14.244654 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 612/1235] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:01:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:01:15.439955 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:01:15.450491 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0baea-79a2-44d4-9ecf-88bd9b0f740b None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:01:15.454983 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:01:15.455650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:15.455926 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:15.456201 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:15.466493 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:01:15.467954 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:01:15.478408 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 624/1236] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:01:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:01:24.240403 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=16 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:01:25.474108 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=9 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:01:28.990253 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:01:29.002078 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945535-c823-4e48-986d-52e20401ec19 service neutron] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:01:29.008435 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:01:29.009090 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:29.009369 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:29.009640 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:29.017776 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:01:29.019451 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:01:29.028797 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 613/1237] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:01:28 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:01:29.203017 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:01:29.211592 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bcbb5-616c-4f1a-a912-2c475396be84 service neutron] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:01:29.215229 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:01:29.215875 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:01:29.216155 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:01:29.216433 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:01:29.223755 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:01:29.225331 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:01:29.233452 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 625/1238] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:01:29 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:01:39.024644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=6 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:01:39.230124 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=6 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:02:14.191963 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:14.247224 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff848f-2a04-4039-8c65-67f67ac2a8a2 service nova] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:14.256744 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:14.257883 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:14.259279 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:14.259825 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:14.271896 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:14.275024 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:14.299941 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 614/1239] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:02:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:02:21.900891 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:21.914512 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49026f4e-9702-4018-8920-63ac597981a1 service neutron] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:21.920280 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:21.920947 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:21.921232 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:21.921484 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:21.931552 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:21.933887 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b173a2-77a2-41b8-9562-cc316d6a167e service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:21.944709 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 626/1240] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:02:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:02:23.419652 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:23.429018 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfd71-c310-4fdf-b600-dd2f48987ede service nova] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:23.432590 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:23.433228 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:23.433582 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:23.434478 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:23.501374 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:23.502909 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3edb-1d56-487b-b3f3-ceb2285704da service neutron] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:23.521681 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 615/1241] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:02:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:02:27.003383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d55d-84f7-49d3-b524-61471b0d3bb0 None None] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:27.004081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d55d-84f7-49d3-b524-61471b0d3bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:27.004081 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d55d-84f7-49d3-b524-61471b0d3bb0 None None] PATH_INFO: `/` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:27.005455 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 627/1242] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 22:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 22:02:27.037814 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f185-c76b-48df-a368-8c68829169a6 None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:27.038384 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f185-c76b-48df-a368-8c68829169a6 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:27.038499 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f185-c76b-48df-a368-8c68829169a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:27.134414 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-6b56f185-c76b-48df-a368-8c68829169a6 None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 22:02:27.135669 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6b56f185-c76b-48df-a368-8c68829169a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:02:27.148051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 616/1243] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 22:02:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 22:02:27.162383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0d55d-84f7-49d3-b524-61471b0d3bb0 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:27.177892 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0d55d-84f7-49d3-b524-61471b0d3bb0 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:27.183091 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:27.183856 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:27.184326 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:27.184845 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:27.194193 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:27.195813 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff84227-6179-4221-bda1-fbb36df95f6f service placement] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:27.207048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 628/1244] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:02:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:02:30.520932 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f501-1d0b-4e08-94be-f236f32de302 None None] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:30.521458 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f501-1d0b-4e08-94be-f236f32de302 None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:30.521558 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f501-1d0b-4e08-94be-f236f32de302 None None] PATH_INFO: `/` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:30.524941 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 617/1245] 10.222.0.17 () {54 vars in 921 bytes} [Fri Jul 15 22:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 22:02:30.553074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] REQUEST_METHOD: `POST` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:30.553606 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:30.553727 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:30.582761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.auth.core [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] MFA Rules not processed for user `02bf2cc0bb194d19ac539163798a09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 22:02:30.582761 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:02:30.583828 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f501-1d0b-4e08-94be-f236f32de302 None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:30.596601 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 629/1246] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Jul 15 22:02:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 22:02:30.602007 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f501-1d0b-4e08-94be-f236f32de302 None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:30.607152 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:30.607562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:30.608091 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:30.608372 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:30.608651 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] PATH_INFO: `/v3/users/969a0d0621664a8dab26e1be8c850782` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:30.609892 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=969a0d0621664a8dab26e1be8c850782)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:30.611868 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:30.618342 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d039-348d-44f9-b823-d6a509222b06 None None] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:30.624292 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:30.624976 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:30.625264 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:30.625562 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:30.634557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:30.636156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:30.647120 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 630/1247] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:02:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:02:30.667422 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969a0d0621664a8dab26e1be8c850782'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:30.668265 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969a0d0621664a8dab26e1be8c850782'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:30.676992 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969a0d0621664a8dab26e1be8c850782'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:30.684690 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969a0d0621664a8dab26e1be8c850782'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:30.685404 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969a0d0621664a8dab26e1be8c850782'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:30.709297 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 618/1248] 10.222.0.17 () {58 vars in 1223 bytes} [Fri Jul 15 22:02:30 2022] DELETE /identity/v3/users/969a0d0621664a8dab26e1be8c850782 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:02:30.903173 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:30.914524 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9234-1fae-4aa7-9738-19023d3ef52a service placement] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:30.976243 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:30.977105 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:30.977383 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:30.977653 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] PATH_INFO: `/v3/projects/43130c77a01b448aa67e7a93a17d418f` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:30.978887 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43130c77a01b448aa67e7a93a17d418f)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:30.980934 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:31.030371 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43130c77a01b448aa67e7a93a17d418f', 'request_id': 'req-caececb6-7902-465f-b0b9-b2669fb660a3'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.040585 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43130c77a01b448aa67e7a93a17d418f', 'request_id': 'req-caececb6-7902-465f-b0b9-b2669fb660a3'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.048333 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43130c77a01b448aa67e7a93a17d418f', 'request_id': 'req-caececb6-7902-465f-b0b9-b2669fb660a3'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.059899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] The token cache is being invalidate because project 43130c77a01b448aa67e7a93a17d418f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 22:02:31.060184 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.060862 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.062528 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 631/1249] 10.222.0.17 () {58 vars in 1232 bytes} [Fri Jul 15 22:02:30 2022] DELETE /identity/v3/projects/43130c77a01b448aa67e7a93a17d418f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:02:31.066882 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:31.068543 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:02:31.078653 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:02:31.082563 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0375d-956d-41e3-b1f5-3ef497725eef admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:31.145852 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:31.146784 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:31.147071 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:31.147358 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] PATH_INFO: `/v3/users/ea76dae37d6c49689f15fbfa1465214f` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:31.148937 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea76dae37d6c49689f15fbfa1465214f)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:31.150918 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:31.206576 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea76dae37d6c49689f15fbfa1465214f'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.207644 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea76dae37d6c49689f15fbfa1465214f'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.219854 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea76dae37d6c49689f15fbfa1465214f'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.227331 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea76dae37d6c49689f15fbfa1465214f'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.228128 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-bcaeb1a1-c51d-4fc1-ac13-845b91ba5e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea76dae37d6c49689f15fbfa1465214f'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.248817 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 619/1250] 10.222.0.17 () {58 vars in 1223 bytes} [Fri Jul 15 22:02:31 2022] DELETE /identity/v3/users/ea76dae37d6c49689f15fbfa1465214f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:02:31.444791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:02:31.446490 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:02:31.461141 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caececb6-7902-465f-b0b9-b2669fb660a3 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:02:31.506499 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:02:31.524599 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:02:31.525504 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:02:31.525791 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:02:31.526103 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] PATH_INFO: `/v3/projects/578100b383f64cc79aa94edb666dfe4f` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:02:31.527311 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] RBAC: Authorizing `identity:delete_project(project_id=578100b383f64cc79aa94edb666dfe4f)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:02:31.529905 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:02:31.578982 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578100b383f64cc79aa94edb666dfe4f', 'request_id': 'req-05bb6a9a-8930-4fde-b929-83ca9a38155f'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.586933 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578100b383f64cc79aa94edb666dfe4f', 'request_id': 'req-05bb6a9a-8930-4fde-b929-83ca9a38155f'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.593111 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578100b383f64cc79aa94edb666dfe4f', 'request_id': 'req-05bb6a9a-8930-4fde-b929-83ca9a38155f'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.603879 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] The token cache is being invalidate because project 578100b383f64cc79aa94edb666dfe4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 22:02:31.604160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.604817 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:02:31.606450 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 632/1251] 10.222.0.17 () {58 vars in 1232 bytes} [Fri Jul 15 22:02:31 2022] DELETE /identity/v3/projects/578100b383f64cc79aa94edb666dfe4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:02:41.243260 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:02:41.601324 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:03:12.245239 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] REQUEST_METHOD: `POST` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:03:12.245788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:03:12.245788 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:03:12.264877 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.auth.core [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] MFA Rules not processed for user `209467ad572243a0b689b38121194291`. Rule list: `[]` (Enabled: `True`). {{(pid=87534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 22:03:12.266130 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:12.326620 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 620/1252] 10.222.0.17 () {58 vars in 957 bytes} [Fri Jul 15 22:03:12 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 22:03:12.666060 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:03:12.668359 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:12.737699 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6a9a-8930-4fde-b929-83ca9a38155f admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:03:12.742048 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:03:12.742698 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:03:12.742985 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:03:12.743257 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:03:12.745345 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:12.755156 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:03:12.756600 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:03:12.764916 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 633/1253] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:03:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:03:13.243445 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:03:13.245053 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:13.336541 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b09a-b879-4d37-bf48-955c1737ffcd None None] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:03:13.342545 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:03:13.343755 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:03:13.344490 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:03:13.344770 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:03:13.346887 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:13.361138 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:03:13.362786 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:03:13.373271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 621/1254] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:03:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:03:21.650813 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:03:21.652315 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:21.728580 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85a34-604a-4423-9969-eb6f2de047b9 service neutron] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:03:21.735782 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580e48715b944a32a3b1218de325b996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:03:21.736466 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:03:21.736750 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:03:21.737031 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:03:21.738899 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:03:21.750989 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:03:21.752611 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:03:21.763751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 634/1255] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:03:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:03:23.368805 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=57 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:03:31.758849 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=58 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:04:20.050016 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:04:20.051700 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:04:20.126794 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581cefd-5f9d-4894-ab55-d99f9b105f7c service placement] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:04:20.134333 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:04:20.135010 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:04:20.135289 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:04:20.135556 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:04:20.138027 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:04:20.151843 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:04:20.153424 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:04:20.163528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 622/1256] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:04:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:04:30.159336 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=28 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:05:49.766439 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:05:49.789770 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417796f7-068e-40a0-8c55-79f647cbe050 service nova] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:05:49.793364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661831a6f5214520a43b84201a4588db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:05:49.794266 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] REQUEST_METHOD: `GET` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:05:49.794549 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:05:49.794850 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:05:49.796631 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:05:49.893518 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:05:49.894924 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:05:49.904894 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 635/1257] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:05:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:05:56.154511 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:05:56.156643 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:05:56.171623 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cbe85-b8b7-47f2-a487-9426e51e875a service placement] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:05:56.177051 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:05:56.178228 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:05:56.178537 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:05:56.178782 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] PATH_INFO: `/v3/users/209467ad572243a0b689b38121194291` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:05:56.194146 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209467ad572243a0b689b38121194291)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:05:56.196197 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:05:56.245598 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209467ad572243a0b689b38121194291'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.246271 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209467ad572243a0b689b38121194291'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.254726 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209467ad572243a0b689b38121194291'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.262320 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209467ad572243a0b689b38121194291'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.262962 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209467ad572243a0b689b38121194291'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.282412 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 623/1258] 10.222.0.17 () {58 vars in 1223 bytes} [Fri Jul 15 22:05:56 2022] DELETE /identity/v3/users/209467ad572243a0b689b38121194291 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:05:56.467364 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:05:56.478074 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c532f-5732-4c33-9e4c-cc48e0eeaec1 service neutron] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:05:56.539160 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:05:56.540378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:05:56.540378 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:05:56.540557 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] PATH_INFO: `/v3/projects/08dd037f33904203970a921d581d0177` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:05:56.551385 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dd037f33904203970a921d581d0177)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:05:56.553593 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:05:56.601343 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dd037f33904203970a921d581d0177', 'request_id': 'req-0d986895-0322-4428-b9db-294a10a94ac9'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.610208 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dd037f33904203970a921d581d0177', 'request_id': 'req-0d986895-0322-4428-b9db-294a10a94ac9'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.611440 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:05:56.618006 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dd037f33904203970a921d581d0177', 'request_id': 'req-0d986895-0322-4428-b9db-294a10a94ac9'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.631753 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] The token cache is being invalidate because project 08dd037f33904203970a921d581d0177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 22:05:56.632043 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.632760 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.634500 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 636/1259] 10.222.0.17 () {58 vars in 1232 bytes} [Fri Jul 15 22:05:56 2022] DELETE /identity/v3/projects/08dd037f33904203970a921d581d0177 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:05:56.638813 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:05:56.640362 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:05:56.656234 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d9dc9-0870-416b-87d6-deea76437d17 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:05:56.727223 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:05:56.728219 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:05:56.728557 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:05:56.728851 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] PATH_INFO: `/v3/users/11226c6696094b76a3ab5c772cd3a7b8` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:05:56.744354 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11226c6696094b76a3ab5c772cd3a7b8)` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:05:56.746344 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:05:56.799210 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11226c6696094b76a3ab5c772cd3a7b8'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.799855 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11226c6696094b76a3ab5c772cd3a7b8'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.803561 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:05:56.809186 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11226c6696094b76a3ab5c772cd3a7b8'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.817175 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11226c6696094b76a3ab5c772cd3a7b8'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.817821 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.notifications [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11226c6696094b76a3ab5c772cd3a7b8'} {{(pid=87534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:56.834816 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 624/1260] 10.222.0.17 () {58 vars in 1223 bytes} [Fri Jul 15 22:05:56 2022] DELETE /identity/v3/users/11226c6696094b76a3ab5c772cd3a7b8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:05:57.026751 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Authenticating user token {{(pid=87535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:05:57.028252 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.fernet_utils [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:05:57.042573 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986895-0322-4428-b9db-294a10a94ac9 admin admin] Validating token access rules against request {{(pid=87535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:05:57.101515 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7948ce1e03b4c18a198a75488650567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f982803038e141998f61945f94c1d197', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:05:57.102415 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:05:57.102696 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:05:57.102965 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] PATH_INFO: `/v3/projects/bd8a4859c56a4060a1be5742e7693730` {{(pid=87535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:05:57.114495 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8a4859c56a4060a1be5742e7693730)` {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:05:57.116459 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] RBAC: Authorization granted {{(pid=87535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:05:57.166650 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8a4859c56a4060a1be5742e7693730', 'request_id': 'req-28f581b6-712b-49ea-8aa5-18c0d4573059'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:57.176964 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8a4859c56a4060a1be5742e7693730', 'request_id': 'req-28f581b6-712b-49ea-8aa5-18c0d4573059'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:57.182987 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8a4859c56a4060a1be5742e7693730', 'request_id': 'req-28f581b6-712b-49ea-8aa5-18c0d4573059'} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:57.195519 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] The token cache is being invalidate because project bd8a4859c56a4060a1be5742e7693730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 22:05:57.195809 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:57.196507 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG keystone.notifications [None req-28f581b6-712b-49ea-8aa5-18c0d4573059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 22:05:57.198134 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: [pid: 87535|app: 0|req: 637/1261] 10.222.0.17 () {58 vars in 1232 bytes} [Fri Jul 15 22:05:57 2022] DELETE /identity/v3/projects/bd8a4859c56a4060a1be5742e7693730 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 22:06:06.831507 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:06:07.192207 dv-osbrick-836063-9-ceph devstack@keystone.service[87535]: DEBUG dbcounter [-] [87535] Writing DB stats keystone:DELETE=9,keystone:SELECT=60,keystone:INSERT=1 {{(pid=87535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 22:09:22.949061 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Authenticating user token {{(pid=87534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 22:09:22.951588 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:09:23.044094 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535e54-3ec8-4b03-bdf3-64c18baea961 admin admin] Validating token access rules against request {{(pid=87534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 22:09:23.106192 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02bf2cc0bb194d19ac539163798a09fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b107630b6535439b8e407711f8a194af', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 22:09:23.106835 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] REQUEST_METHOD: `GET` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 22:09:23.107124 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] SCRIPT_NAME: `/identity` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 22:09:23.107397 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 22:09:23.109466 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.fernet_utils [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 22:09:23.120673 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 22:09:23.122300 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0e29-341b-40ed-bd22-a54265a002a2 service placement] RBAC: Authorization granted {{(pid=87534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 22:09:23.132528 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: [pid: 87534|app: 0|req: 625/1262] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Jul 15 22:09:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 22:09:33.128343 dv-osbrick-836063-9-ceph devstack@keystone.service[87534]: DEBUG dbcounter [-] [87534] Writing DB stats keystone:SELECT=62 {{(pid=87534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}